You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/11/02 01:58:11 UTC
[JENKINS] Lucene-Solr-Tests-7.x - Build # 210 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/210/
No tests ran.
Build Log:
[...truncated 11695 lines...]
[junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J0-20171101_225113_066886789534836535979.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # There is insufficient memory for the Java Runtime Environment to continue.
[junit4] # Native memory allocation (mmap) failed to map 44040192 bytes for committing reserved memory.
[junit4] # An error report file with more information is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/hs_err_pid29289.log
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J0-20171101_225113_066829234350085015639.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000ea980000, 44040192, 0) failed; error='Cannot allocate memory' (errno=12)
[junit4] <<< JVM J0: EOF ----
[...truncated 153 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest
[junit4] 2> 1041213 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/init-core-data-001
[junit4] 2> 1041213 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1041214 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1041214 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001
[junit4] 2> 1041214 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1041215 INFO (Thread-422) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1041215 INFO (Thread-422) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1041331 ERROR (Thread-422) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1041331 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:57542
[junit4] 2> 1041437 INFO (jetty-launcher-479-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1041437 INFO (jetty-launcher-479-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1041438 INFO (jetty-launcher-479-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5c00d5b5{/solr,null,AVAILABLE}
[junit4] 2> 1041451 INFO (jetty-launcher-479-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@517afa5c{HTTP/1.1,[http/1.1]}{127.0.0.1:47504}
[junit4] 2> 1041451 INFO (jetty-launcher-479-thread-1) [ ] o.e.j.s.Server Started @1064698ms
[junit4] 2> 1041451 INFO (jetty-launcher-479-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47504}
[junit4] 2> 1041451 ERROR (jetty-launcher-479-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1041451 INFO (jetty-launcher-479-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 1041451 INFO (jetty-launcher-479-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1041451 INFO (jetty-launcher-479-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1041451 INFO (jetty-launcher-479-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-01T23:08:57.977Z
[junit4] 2> 1042715 INFO (jetty-launcher-479-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d22bd95{/solr,null,AVAILABLE}
[junit4] 2> 1042716 INFO (jetty-launcher-479-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@b104c48{HTTP/1.1,[http/1.1]}{127.0.0.1:59076}
[junit4] 2> 1042716 INFO (jetty-launcher-479-thread-2) [ ] o.e.j.s.Server Started @1065963ms
[junit4] 2> 1042716 INFO (jetty-launcher-479-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59076}
[junit4] 2> 1042717 ERROR (jetty-launcher-479-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1042717 INFO (jetty-launcher-479-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 1042717 INFO (jetty-launcher-479-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1042717 INFO (jetty-launcher-479-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1042717 INFO (jetty-launcher-479-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-01T23:08:59.243Z
[junit4] 2> 1042834 INFO (jetty-launcher-479-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1042876 INFO (jetty-launcher-479-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1042901 INFO (jetty-launcher-479-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57542/solr
[junit4] 2> 1042915 INFO (jetty-launcher-479-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57542/solr
[junit4] 2> 1043309 INFO (jetty-launcher-479-thread-2) [n:127.0.0.1:59076_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1043309 INFO (jetty-launcher-479-thread-2) [n:127.0.0.1:59076_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59076_solr
[junit4] 2> 1043310 INFO (jetty-launcher-479-thread-2) [n:127.0.0.1:59076_solr ] o.a.s.c.Overseer Overseer (id=98931686625443846-127.0.0.1:59076_solr-n_0000000000) starting
[junit4] 2> 1043444 INFO (jetty-launcher-479-thread-2) [n:127.0.0.1:59076_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59076_solr
[junit4] 2> 1043565 INFO (zkCallback-492-thread-1-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1043905 INFO (jetty-launcher-479-thread-1) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1043906 INFO (jetty-launcher-479-thread-1) [n:127.0.0.1:47504_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1043908 INFO (jetty-launcher-479-thread-1) [n:127.0.0.1:47504_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47504_solr
[junit4] 2> 1043915 INFO (zkCallback-492-thread-1-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1044217 INFO (zkCallback-490-thread-1-processing-n:127.0.0.1:47504_solr) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1044586 INFO (jetty-launcher-479-thread-2) [n:127.0.0.1:59076_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59076.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1044715 INFO (jetty-launcher-479-thread-2) [n:127.0.0.1:59076_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59076.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1044715 INFO (jetty-launcher-479-thread-2) [n:127.0.0.1:59076_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59076.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1044732 INFO (jetty-launcher-479-thread-2) [n:127.0.0.1:59076_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/.
[junit4] 2> 1044794 INFO (jetty-launcher-479-thread-1) [n:127.0.0.1:47504_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47504.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1044880 INFO (jetty-launcher-479-thread-1) [n:127.0.0.1:47504_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47504.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1044915 INFO (jetty-launcher-479-thread-1) [n:127.0.0.1:47504_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47504.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1044916 INFO (jetty-launcher-479-thread-1) [n:127.0.0.1:47504_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node1/.
[junit4] 2> 1046272 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1046273 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1046311 INFO (TEST-AutoScalingHandlerTest.testDeleteUsedPolicy-seed#[1C436BE69425E52E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteUsedPolicy
[junit4] 2> 1047967 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1047968 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1047989 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1048170 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1048186 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=424
[junit4] 2> 1048186 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=COLL1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2&policy=nodelete and sendToOCPQueue=true
[junit4] 2> 1048214 INFO (OverseerThreadFactory-919-thread-1-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.CreateCollectionCmd Create collection COLL1
[junit4] 2> 1048345 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1048417 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1049768 INFO (OverseerStateUpdate-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"COLL1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"COLL1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59076/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1050042 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=COLL1_shard1_replica_n1&action=CREATE&numShards=1&collection=COLL1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1050043 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1050162 INFO (zkCallback-492-thread-1-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1050180 INFO (zkCallback-492-thread-2-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1051150 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1051260 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.s.IndexSchema [COLL1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1051363 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1051363 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'COLL1_shard1_replica_n1' using configuration from collection COLL1, trusted=true
[junit4] 2> 1051363 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59076.solr.core.COLL1.shard1.replica_n1' (registry 'solr.core.COLL1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1051364 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1051364 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SolrCore [[COLL1_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/COLL1_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/./COLL1_shard1_replica_n1/data/]
[junit4] 2> 1053973 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1053973 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1053974 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1053974 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1053997 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@537c362d[COLL1_shard1_replica_n1] main]
[junit4] 2> 1054017 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1054018 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1054018 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1054019 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582906999355473920
[junit4] 2> 1054116 INFO (searcherExecutor-924-thread-1-processing-n:127.0.0.1:59076_solr x:COLL1_shard1_replica_n1 s:shard1 c:COLL1 r:core_node2) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SolrCore [COLL1_shard1_replica_n1] Registered new searcher Searcher@537c362d[COLL1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1054121 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1054121 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1054122 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59076/solr/COLL1_shard1_replica_n1/
[junit4] 2> 1054122 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1054122 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:59076/solr/COLL1_shard1_replica_n1/ has no replicas
[junit4] 2> 1054122 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1054126 INFO (zkCallback-492-thread-3-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1054126 INFO (zkCallback-492-thread-2-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1054127 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59076/solr/COLL1_shard1_replica_n1/ shard1
[junit4] 2> 1054128 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1054129 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=COLL1_shard1_replica_n1&action=CREATE&numShards=1&collection=COLL1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4087
[junit4] 2> 1054137 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1054240 INFO (zkCallback-492-thread-2-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1054240 INFO (zkCallback-492-thread-3-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1054254 INFO (OverseerCollectionConfigSetProcessor-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1055145 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=COLL1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2&policy=nodelete} status=0 QTime=6958
[junit4] 2> 1055213 ERROR (qtp351588003-2389) [n:127.0.0.1:59076_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.api.ApiBag$ExceptionWithErrObject: Error in command payload, errors: [{remove-policy=nodelete, errorMessages=[policy : nodelete is being used by collection COLL1]}],
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.processOps(AutoScalingHandler.java:211)
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.handleRequestBody(AutoScalingHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.api.ApiBag$ReqHandlerToApi.call(ApiBag.java:242)
[junit4] 2> at org.apache.solr.api.V2HttpCall.handleAdmin(V2HttpCall.java:308)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1055213 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=400 QTime=4
[junit4] 2> 1055222 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=COLL1&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1055281 INFO (OverseerThreadFactory-919-thread-2-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 1055282 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.COLL1.shard1.replica_n1, tag=null
[junit4] 2> 1055282 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@88cefab: rootName = solr_59076, domain = solr.core.COLL1.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.COLL1.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@75ca32d6
[junit4] 2> 1055326 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.c.SolrCore [COLL1_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@10e816e1
[junit4] 2> 1055326 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.COLL1.shard1.replica_n1, tag=283645665
[junit4] 2> 1055326 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.COLL1.shard1.leader, tag=283645665
[junit4] 2> 1055423 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=COLL1_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=141
[junit4] 2> 1056185 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=COLL1&action=DELETE&wt=javabin&version=2} status=0 QTime=963
[junit4] 2> 1056186 INFO (TEST-AutoScalingHandlerTest.testDeleteUsedPolicy-seed#[1C436BE69425E52E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteUsedPolicy
[junit4] 2> 1056316 INFO (TEST-AutoScalingHandlerTest.testSuspendTrigger-seed#[1C436BE69425E52E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSuspendTrigger
[junit4] 2> 1056324 INFO (qtp46097853-2373) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=7
[junit4] 2> 1056341 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1056765 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1056766 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1056773 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1057307 INFO (OverseerCollectionConfigSetProcessor-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1057429 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1057434 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=1085
[junit4] 2> 1058406 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1058406 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1058414 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1058415 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1058534 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=1099
[junit4] 2> 1059954 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1059954 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1059956 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1059957 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1059997 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=1462
[junit4] 2> 1060364 INFO (qtp46097853-2373) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1060365 INFO (qtp46097853-2373) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1060369 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060369 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060434 INFO (qtp46097853-2373) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=436
[junit4] 2> 1060489 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1060490 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1060490 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060491 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060514 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=69
[junit4] 2> 1060598 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1060599 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1060599 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060615 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060626 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=111
[junit4] 2> 1060676 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1060677 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1060677 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060677 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060696 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=68
[junit4] 2> 1060705 INFO (TEST-AutoScalingHandlerTest.testSuspendTrigger-seed#[1C436BE69425E52E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSuspendTrigger
[junit4] 2> 1060796 INFO (TEST-AutoScalingHandlerTest.testPolicyAndPreferences-seed#[1C436BE69425E52E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testPolicyAndPreferences
[junit4] 2> 1060810 ERROR (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.api.ApiBag$ExceptionWithErrObject: Error in command payload, errors: [{set-policy={xyz=[{replica=<2, shard=#EACH, node=#ANY}, {nodeRole=!overseer, replica=0}], policy1=[{cores=<2, node=#ANY}, {replica=<2, shard=#EACH, node=#ANY}]}, errorMessages=[cores is only allowed in 'cluster-policy']}],
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.processOps(AutoScalingHandler.java:211)
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.handleRequestBody(AutoScalingHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.api.ApiBag$ReqHandlerToApi.call(ApiBag.java:242)
[junit4] 2> at org.apache.solr.api.V2HttpCall.handleAdmin(V2HttpCall.java:308)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1060812 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=400 QTime=3
[junit4] 2> 1060850 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1060851 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1060851 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060865 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060876 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=63
[junit4] 2> 1060914 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1060915 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1060915 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060915 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1060917 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=40
[junit4] 2> 1060981 INFO (qtp351588003-2388) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1060981 INFO (qtp351588003-2388) [n:127.0.0.1:59076_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1060982 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1061005 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1061018 INFO (qtp351588003-2388) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=81
[junit4] 2> 1061062 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1061062 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1061402 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=337
[junit4] 2> 1061403 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1061417 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=398
[junit4] 2> 1061533 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1061537 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1061545 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm} status=0 QTime=0
[junit4] 2> 1061546 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm} status=0 QTime=0
[junit4] 2> 1061560 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=63
[junit4] 2> 1061647 INFO (qtp46097853-2373) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1061648 INFO (qtp46097853-2373) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1061665 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName,os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm,solr.core} status=0 QTime=0
[junit4] 2> 1061685 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName,os.systemLoadAverage&wt=javabin&version=2&group=solr.jvm,solr.core} status=0 QTime=0
[junit4] 2> 1061747 INFO (qtp46097853-2373) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=186
[junit4] 2> 1061764 INFO (TEST-AutoScalingHandlerTest.testPolicyAndPreferences-seed#[1C436BE69425E52E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testPolicyAndPreferences
[junit4] 2> 1061867 INFO (TEST-AutoScalingHandlerTest.testReadApi-seed#[1C436BE69425E52E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testReadApi
[junit4] 2> 1061941 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1061944 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1061945 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1061965 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1062015 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=146
[junit4] 2> 1062434 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1062435 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1063977 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1063978 INFO (qtp351588003-2388) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1063990 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=1962
[junit4] 2> 1064346 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1064346 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1064354 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=7
[junit4] 2> 1064365 INFO (qtp351588003-2388) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1064390 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=400
[junit4] 2> 1064425 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1064444 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1064445 INFO (qtp46097853-2373) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1064446 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1064493 INFO (qtp46097853-2377) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=101
[junit4] 2> 1064497 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 1064589 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1064593 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1064626 INFO (qtp46097853-2376) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1064665 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1064705 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling/diagnostics params={wt=javabin&version=2} status=0 QTime=200
[junit4] 2> 1064705 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=6&collection.configName=conf&maxShardsPerNode=10&name=readApiTestViolations&nrtReplicas=6&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1064707 INFO (OverseerThreadFactory-919-thread-3-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.CreateCollectionCmd Create collection readApiTestViolations
[junit4] 2> 1064708 ERROR (OverseerThreadFactory-919-thread-3-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: readApiTestViolations operation: create failed:org.apache.solr.common.SolrException: 'maxShardsPerNode>0' is not supported when autoScaling policies are used
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:136)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1064716 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=6&collection.configName=conf&maxShardsPerNode=10&name=readApiTestViolations&nrtReplicas=6&action=CREATE&numShards=1&wt=javabin&version=2} status=400 QTime=11
[junit4] 2> 1064761 INFO (OverseerCollectionConfigSetProcessor-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1064867 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1064867 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:57542/solr ready
[junit4] 2> 1064868 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1064886 INFO (qtp351588003-2386) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1064946 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f79d84657001c, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1064952 INFO (qtp351588003-2385) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=231
[junit4] 2> 1064957 INFO (qtp46097853-2380) [n:127.0.0.1:47504_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=6&collection.configName=conf&name=readApiTestViolations&nrtReplicas=6&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1064989 INFO (OverseerThreadFactory-919-thread-4-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.CreateCollectionCmd Create collection readApiTestViolations
[junit4] 2> 1064990 WARN (OverseerThreadFactory-919-thread-4-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 6 on collection readApiTestViolations is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 1065097 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1065114 INFO (qtp351588003-2383) [n:127.0.0.1:59076_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName,os.systemLoadAverage,memory.heap.usage&wt=javabin&version=2&group=solr.jvm,solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1066334 INFO (OverseerStateUpdate-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:47504/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1066336 INFO (OverseerStateUpdate-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59076/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1066353 INFO (OverseerStateUpdate-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:47504/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1066419 INFO (OverseerStateUpdate-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n7",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59076/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1066513 INFO (OverseerStateUpdate-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n9",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:47504/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1067046 INFO (OverseerStateUpdate-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"readApiTestViolations",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"readApiTestViolations_shard1_replica_n11",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59076/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1067245 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n1&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1067245 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1067248 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n4&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1067252 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node10&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n9&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1067254 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n7&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1067269 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n2&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1067269 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node12&collection.configName=conf&newCollection=true&name=readApiTestViolations_shard1_replica_n11&action=CREATE&numShards=1&collection=readApiTestViolations&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1067381 INFO (zkCallback-492-thread-3-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1067384 INFO (zkCallback-492-thread-2-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1067384 INFO (zkCallback-490-thread-1-processing-n:127.0.0.1:47504_solr) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1068274 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1068286 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1068301 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1068320 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1068414 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n7] Schema name=minimal
[junit4] 2> 1068434 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n9] Schema name=minimal
[junit4] 2> 1068435 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1068438 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1068438 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n7' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 1068439 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59076.solr.core.readApiTestViolations.shard1.replica_n7' (registry 'solr.core.readApiTestViolations.shard1.replica_n7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1068439 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1068439 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n7] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/readApiTestViolations_shard1_replica_n7], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/./readApiTestViolations_shard1_replica_n7/data/]
[junit4] 2> 1068485 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1068507 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n2] Schema name=minimal
[junit4] 2> 1068509 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1068509 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n9' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 1068509 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47504.solr.core.readApiTestViolations.shard1.replica_n9' (registry 'solr.core.readApiTestViolations.shard1.replica_n9') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1068509 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1068509 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n9] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node1/readApiTestViolations_shard1_replica_n9], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node1/./readApiTestViolations_shard1_replica_n9/data/]
[junit4] 2> 1068526 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n11] Schema name=minimal
[junit4] 2> 1068528 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1068528 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n11' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 1068540 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1068540 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n2' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 1068541 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59076.solr.core.readApiTestViolations.shard1.replica_n2' (registry 'solr.core.readApiTestViolations.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1068541 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1068541 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/readApiTestViolations_shard1_replica_n2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/./readApiTestViolations_shard1_replica_n2/data/]
[junit4] 2> 1068562 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1068564 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1068564 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n1' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 1068578 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.s.IndexSchema [readApiTestViolations_shard1_replica_n4] Schema name=minimal
[junit4] 2> 1068580 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1068580 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'readApiTestViolations_shard1_replica_n4' using configuration from collection readApiTestViolations, trusted=true
[junit4] 2> 1068580 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47504.solr.core.readApiTestViolations.shard1.replica_n4' (registry 'solr.core.readApiTestViolations.shard1.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1068580 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1068589 INFO (qtp46097853-2379) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n4] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node1/readApiTestViolations_shard1_replica_n4], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node1/./readApiTestViolations_shard1_replica_n4/data/]
[junit4] 2> 1068812 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47504.solr.core.readApiTestViolations.shard1.replica_n1' (registry 'solr.core.readApiTestViolations.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1068812 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1068813 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node1/readApiTestViolations_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node1/./readApiTestViolations_shard1_replica_n1/data/]
[junit4] 2> 1068589 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59076.solr.core.readApiTestViolations.shard1.replica_n11' (registry 'solr.core.readApiTestViolations.shard1.replica_n11') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68d6f828
[junit4] 2> 1069492 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1069493 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1069493 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1069493 INFO (qtp351588003-2389) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.c.SolrCore [[readApiTestViolations_shard1_replica_n11] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/readApiTestViolations_shard1_replica_n11], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001/tempDir-001/node2/./readApiTestViolations_shard1_replica_n11/data/]
[junit4] 2> 1069493 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1069494 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1069543 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1069543 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1069544 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1069544 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1069572 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.s.SolrIndexSearcher Opening [Searcher@58223732[readApiTestViolations_shard1_replica_n7] main]
[junit4] 2> 1069572 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.s.SolrIndexSearcher Opening [Searcher@5680995e[readApiTestViolations_shard1_replica_n9] main]
[junit4] 2> 1069573 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1069574 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1069574 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1069574 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1069575 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1069575 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1069575 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582907015667122176
[junit4] 2> 1069605 INFO (searcherExecutor-929-thread-1-processing-n:127.0.0.1:59076_solr x:readApiTestViolations_shard1_replica_n7 s:shard1 c:readApiTestViolations r:core_node8) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n7] Registered new searcher Searcher@58223732[readApiTestViolations_shard1_replica_n7] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1069605 INFO (qtp351588003-2382) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582907015698579456
[junit4] 2> 1069609 INFO (searcherExecutor-930-thread-1-processing-n:127.0.0.1:47504_solr x:readApiTestViolations_shard1_replica_n9 s:shard1 c:readApiTestViolations r:core_node10) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n9] Registered new searcher Searcher@5680995e[readApiTestViolations_shard1_replica_n9] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1069609 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1069609 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1069613 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1069614 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1069629 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@491d1cf8[readApiTestViolations_shard1_replica_n1] main]
[junit4] 2> 1070413 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1070413 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1070414 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1070414 INFO (qtp46097853-2374) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582907016546877440
[junit4] 2> 1070498 INFO (zkCallback-490-thread-1-processing-n:127.0.0.1:47504_solr) [n:127.0.0.1:47504_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1070499 INFO (zkCallback-492-thread-3-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1070499 INFO (zkCallback-492-thread-2-processing-n:127.0.0.1:59076_solr) [n:127.0.0.1:59076_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/readApiTestViolations/state.json] for collection [readApiTestViolations] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1070524 INFO (qtp46097853-2378) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node10 x:readApiTestViolations_shard1_replica_n9] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=6 found=2 timeoutin=9993ms
[junit4] 2> 1070610 INFO (searcherExecutor-933-thread-1-processing-n:127.0.0.1:47504_solr x:readApiTestViolations_shard1_replica_n1 s:shard1 c:readApiTestViolations r:core_node3) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node3 x:readApiTestViolations_shard1_replica_n1] o.a.s.c.SolrCore [readApiTestViolations_shard1_replica_n1] Registered new searcher Searcher@491d1cf8[readApiTestViolations_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1070879 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1070879 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1070885 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1070885 INFO (qtp351588003-2387) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1070889 INFO (qtp35158800
[...truncated too long message...]
metrics.reporters.SolrJmxReporter@5238089c: rootName = solr_57308, domain = solr.core.readApiTestViolations.shard1.replica_n13, service url = null, agent id = null] for registry solr.core.readApiTestViolations.shard1.replica_n13 / com.codahale.metrics.MetricRegistry@486073d2
[junit4] 2> 1103132 INFO (zkCallback-569-thread-3-processing-n:127.0.0.1:57308_solr) [n:127.0.0.1:57308_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (0)
[junit4] 2> 1103133 INFO (coreCloseExecutor-970-thread-2) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@64a667d2: rootName = solr_47504, domain = solr.core.readApiTestViolations.shard1.replica_n4, service url = null, agent id = null] for registry solr.core.readApiTestViolations.shard1.replica_n4 / com.codahale.metrics.MetricRegistry@2088140e
[junit4] 2> 1103178 INFO (coreCloseExecutor-972-thread-1) [n:127.0.0.1:57308_solr c:readApiTestViolations s:shard1 r:core_node14 x:readApiTestViolations_shard1_replica_n13] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.readApiTestViolations.shard1.leader, tag=1604109779
[junit4] 2> 1103191 INFO (coreCloseExecutor-970-thread-2) [n:127.0.0.1:47504_solr c:readApiTestViolations s:shard1 r:core_node6 x:readApiTestViolations_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.readApiTestViolations.shard1.leader, tag=1127557188
[junit4] 2> 1103236 INFO (coreCloseExecutor-971-thread-1) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.readApiTestViolations.shard1.replica_n7, tag=592287867
[junit4] 2> 1103236 INFO (coreCloseExecutor-971-thread-1) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ada1d64: rootName = solr_59076, domain = solr.core.readApiTestViolations.shard1.replica_n7, service url = null, agent id = null] for registry solr.core.readApiTestViolations.shard1.replica_n7 / com.codahale.metrics.MetricRegistry@522db41d
[junit4] 2> 1103284 INFO (coreCloseExecutor-971-thread-3) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.readApiTestViolations.shard1.replica_n11, tag=1230924101
[junit4] 2> 1103285 INFO (coreCloseExecutor-971-thread-3) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3e5c6163: rootName = solr_59076, domain = solr.core.readApiTestViolations.shard1.replica_n11, service url = null, agent id = null] for registry solr.core.readApiTestViolations.shard1.replica_n11 / com.codahale.metrics.MetricRegistry@b2ad14f
[junit4] 2> 1105289 INFO (coreCloseExecutor-971-thread-1) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node8 x:readApiTestViolations_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.readApiTestViolations.shard1.leader, tag=592287867
[junit4] 2> 1105290 INFO (coreCloseExecutor-971-thread-2) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node5 x:readApiTestViolations_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.readApiTestViolations.shard1.leader, tag=1485196105
[junit4] 2> 1105290 INFO (coreCloseExecutor-971-thread-3) [n:127.0.0.1:59076_solr c:readApiTestViolations s:shard1 r:core_node12 x:readApiTestViolations_shard1_replica_n11] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.readApiTestViolations.shard1.leader, tag=1230924101
[junit4] 2> 1105597 INFO (jetty-closer-480-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6595d48e{/solr,null,UNAVAILABLE}
[junit4] 2> 1105625 INFO (jetty-closer-480-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98931686625443846-127.0.0.1:59076_solr-n_0000000000) closing
[junit4] 2> 1105625 INFO (OverseerStateUpdate-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:59076_solr
[junit4] 2> 1105626 WARN (OverseerAutoScalingTriggerThread-98931686625443846-127.0.0.1:59076_solr-n_0000000000) [n:127.0.0.1:59076_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1106364 INFO (jetty-closer-480-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5c00d5b5{/solr,null,UNAVAILABLE}
[junit4] 2> 1106364 INFO (jetty-closer-480-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5d22bd95{/solr,null,UNAVAILABLE}
[junit4] 2> 1106414 ERROR (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1106414 INFO (SUITE-AutoScalingHandlerTest-seed#[1C436BE69425E52E]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57542 57542
[junit4] 2> 1106565 INFO (Thread-422) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57542 57542
[junit4] 2> 1106566 WARN (Thread-422) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 200 /solr/aliases.json
[junit4] 2> 200 /solr/clusterprops.json
[junit4] 2> 4 /solr/configs/conf
[junit4] 2> 3 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 200 /solr/clusterstate.json
[junit4] 2> 24 /solr/collections/readApiTestViolations/state.json
[junit4] 2> 5 /solr/collections/COLL1/state.json
[junit4] 2> 2 /solr/overseer_elect/election/98931686625443846-127.0.0.1:59076_solr-n_0000000000
[junit4] 2> 2 /solr/collections/readApiTestViolations/leader_elect/shard1/election/98931686625443846-core_node8-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 200 /solr/live_nodes
[junit4] 2> 200 /solr/collections
[junit4] 2> 2 /solr/autoscaling/events/node_lost_trigger
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_1C436BE69425E52E-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=es-CR, timezone=Africa/Lusaka
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=143056976,total=393740288
[junit4] 2> NOTE: All tests run in this JVM: [TestLMDirichletSimilarityFactory, TestFuzzyAnalyzedSuggestions, XmlUpdateRequestHandlerTest, TestConfigSetsAPI, CoreMergeIndexesAdminHandlerTest, TestRetrieveFieldsOptimizer, TestCloudNestedDocsSort, TestDelegationWithHadoopAuth, ScriptEngineTest, TestPartialUpdateDeduplication, ChaosMonkeyNothingIsSafeTest, TestFieldCacheSort, TestPushWriter, TestShardHandlerFactory, CloneFieldUpdateProcessorFactoryTest, TestStressCloudBlindAtomicUpdates, TestMacros, TestFunctionQuery, RegexBytesRefFilterTest, TestShortCircuitedRequests, TestUseDocValuesAsStored, ConnectionReuseTest, CollectionReloadTest, TestCoreContainer, AsyncCallRequestStatusResponseTest, CollectionsAPIAsyncDistributedZkTest, TestFieldTypeCollectionResource, TestSolrXml, ConjunctionSolrSpellCheckerTest, TestStandardQParsers, AutoScalingHandlerTest]
[junit4] Completed [70/746 (1!)] on J2 in 66.35s, 7 tests, 1 failure <<< FAILURES!
[...truncated 315 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J1-20171101_225113_0705016330672934723713.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # There is insufficient memory for the Java Runtime Environment to continue.
[junit4] # Native memory allocation (mmap) failed to map 30408704 bytes for committing reserved memory.
[junit4] # An error report file with more information is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/hs_err_pid29282.log
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J1-20171101_225113_07082876860693113745.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000f2480000, 30408704, 0) failed; error='Cannot allocate memory' (errno=12)
[junit4] <<< JVM J1: EOF ----
[...truncated 1272 lines...]
ERROR: command execution failed.
ERROR: Step ‘Archive the artifacts’ failed: no workspace for Lucene-Solr-Tests-7.x #210
ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for Lucene-Solr-Tests-7.x #210
ERROR: lucene is offline; cannot locate JDK 1.8 (latest)
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
ERROR: lucene is offline; cannot locate JDK 1.8 (latest)
ERROR: lucene is offline; cannot locate JDK 1.8 (latest)
[JENKINS] Lucene-Solr-Tests-7.x - Build # 212 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/212/
3 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:52425_solr wasn't created
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:52425_solr wasn't created
at __randomizedtesting.SeedInfo.seed([7C8F5B58BD09AB84:6435D354B33C666B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:909)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig
Error Message:
The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
Stack Trace:
java.lang.RuntimeException: The max direct memory is likely too low. Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
at __randomizedtesting.SeedInfo.seed([7C8F5B58BD09AB84:8B209273408041AF]:0)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:311)
at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:293)
at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:227)
at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:111)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError
at sun.misc.Unsafe.allocateMemory(Native Method)
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:127)
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:71)
at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:309)
... 42 more
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
ObjectTracker found 4 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036) at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:642) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036) at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:642) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298) at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:224) at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:266) at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHandler.java:1214) at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:696) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:968) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036) at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:642) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036) at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:642) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 4 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036)
at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:642)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036)
at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:642)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:224)
at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:266)
at org.apache.solr.handler.ReplicationHandler.inform(ReplicationHandler.java:1214)
at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:696)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:968)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036)
at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:642)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036)
at org.apache.solr.core.CoreContainer.lambda$load$13(CoreContainer.java:642)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([7C8F5B58BD09AB84]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:295)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11613 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> 0 INFO (SUITE-TestReplicationHandler-seed#[7C8F5B58BD09AB84]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/init-core-data-001
[junit4] 2> 1938 INFO (SUITE-TestReplicationHandler-seed#[7C8F5B58BD09AB84]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 2490 INFO (SUITE-TestReplicationHandler-seed#[7C8F5B58BD09AB84]-worker) [ ] o.e.j.u.log Logging initialized @25869ms
[junit4] 2> 2566 INFO (SUITE-TestReplicationHandler-seed#[7C8F5B58BD09AB84]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
[junit4] 2> 2868 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestReplicateAfterStartupWithNoActivity
[junit4] 2> 2869 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/collection1
[junit4] 2> 3672 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3842 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@945852{/solr,null,AVAILABLE}
[junit4] 2> 3881 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@eb7fd65{HTTP/1.1,[http/1.1]}{127.0.0.1:38544}
[junit4] 2> 3884 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.Server Started @27304ms
[junit4] 2> 3885 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=38544}
[junit4] 2> 4225 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4226 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 4227 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 4227 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 5018 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-02T17:53:58.357Z
[junit4] 2> 6429 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 6451 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/solr.xml
[junit4] 2> 7494 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 7494 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 15769 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/.
[junit4] 2> 15963 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 16006 INFO (coreLoadExecutor-6-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 16822 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 18411 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 18612 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 18618 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/./collection1, trusted=true
[junit4] 2> 20422 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 20433 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/./collection1/data/]
[junit4] 2> 20998 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=69772601, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 30306 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 30306 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 30470 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=67.498046875, floorSegmentMB=0.4296875, forceMergeDeletesPctAllowed=12.490041651131117, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 30621 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4e37fedc[collection1] main]
[junit4] 2> 30846 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/collection1/conf
[junit4] 2> 31594 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 31594 INFO (coreLoadExecutor-6-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 33025 INFO (searcherExecutor-7-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4e37fedc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 33182 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-002/collection1
[junit4] 2> 33225 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 34222 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6a9ba488{/solr,null,AVAILABLE}
[junit4] 2> 34223 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@48564c61{HTTP/1.1,[http/1.1]}{127.0.0.1:59913}
[junit4] 2> 34223 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.Server Started @57646ms
[junit4] 2> 34223 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=59913}
[junit4] 2> 34223 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 34223 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 34224 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 34224 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 34224 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-02T17:54:28.353Z
[junit4] 2> 34258 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-002/solr.xml
[junit4] 2> 34328 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 34329 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 34803 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-002/.
[junit4] 2> 34803 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 34870 INFO (coreLoadExecutor-16-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 35220 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 35677 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 35705 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 35705 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-002/./collection1, trusted=true
[junit4] 2> 35762 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 35763 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-002/./collection1/data/]
[junit4] 2> 35834 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=69772601, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 39233 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 39263 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 39269 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=67.498046875, floorSegmentMB=0.4296875, forceMergeDeletesPctAllowed=12.490041651131117, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 39271 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@741358fd[collection1] main]
[junit4] 2> 39271 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-002/collection1/conf
[junit4] 2> 39309 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 39334 INFO (coreLoadExecutor-16-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 39354 INFO (searcherExecutor-17-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@741358fd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 39415 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@48564c61{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 39416 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1553089445
[junit4] 2> 39510 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 39510 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 39510 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 39545 INFO (coreCloseExecutor-22-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@5e5972c3
[junit4] 2> 39546 INFO (coreCloseExecutor-22-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1582920387
[junit4] 2> 39749 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6a9ba488{/solr,null,UNAVAILABLE}
[junit4] 2> 43598 INFO (qtp1413793290-17) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 43622 INFO (qtp1413793290-17) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 1552
[junit4] 2> 44047 INFO (qtp1413793290-18) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 44049 INFO (qtp1413793290-18) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@79c3903e commitCommandVersion:0
[junit4] 2> 44070 INFO (qtp1413793290-18) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@36397b4d[collection1] main]
[junit4] 2> 44072 INFO (qtp1413793290-18) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 44074 INFO (searcherExecutor-7-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@36397b4d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 44113 INFO (qtp1413793290-18) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 66
[junit4] 2> 44197 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@eb7fd65{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 44197 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=395640342
[junit4] 2> 44201 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 44202 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 44202 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 44249 INFO (coreCloseExecutor-24-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@5f7083c4
[junit4] 2> 44250 INFO (coreCloseExecutor-24-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1601209284
[junit4] 2> 44358 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@945852{/solr,null,UNAVAILABLE}
[junit4] 2> 44370 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 45722 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@455b7d8a{/solr,null,AVAILABLE}
[junit4] 2> 45723 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@78708d13{HTTP/1.1,[http/1.1]}{127.0.0.1:41218}
[junit4] 2> 45723 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.e.j.s.Server Started @69145ms
[junit4] 2> 45723 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=41218}
[junit4] 2> 45723 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 45723 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 45724 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 45724 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 45724 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-02T17:54:39.853Z
[junit4] 2> 45724 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/solr.xml
[junit4] 2> 45796 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 45796 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 46635 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/.
[junit4] 2> 46635 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[7C8F5B58BD09AB84]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 46697 INFO (coreLoadExecutor-31-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 47022 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 47247 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 47328 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 47328 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/./collection1, trusted=true
[junit4] 2> 48290 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 48291 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/./collection1/data/]
[junit4] 2> 48586 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=67.3017578125, floorSegmentMB=2.162109375, forceMergeDeletesPctAllowed=0.8559373645425317, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.12952153002437009
[junit4] 2> 51451 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 51451 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 51453 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2ae8c51
[junit4] 2> 51578 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17302c27[collection1] main]
[junit4] 2> 51578 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_7C8F5B58BD09AB84-001/solr-instance-001/collection1/conf
[junit4] 2> 51579 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml
[junit4] 2> 51579 INFO (coreLoadExecutor-31-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 51589 INFO (searcherExecutor-32-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@17302c27[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 54711 INFO (qtp368937818-58) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 1536
[junit4] 2> 54723 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 1
[junit4] 2> 54731 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 54763 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
[junit4] 2> 54767 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 54788 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 54806 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 54809 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 54832 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 54855 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 1
[junit4] 2> 54866 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 54907 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
[junit4] 2> 54939 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
[junit4] 2> 54959 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 17
[junit4] 2> 54983 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
[junit4] 2> 54985 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
[junit4] 2> 55168 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 1
[junit4] 2> 55174 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
[junit4] 2> 55176 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
[junit4] 2> 55180 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
[junit4] 2> 55184 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
[junit4] 2> 55186 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
[junit4] 2> 55189 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
[junit4] 2> 55193 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 1
[junit4] 2> 55197 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
[junit4] 2> 55198 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
[junit4] 2> 55202 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
[junit4] 2> 55204 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
[junit4] 2> 55225 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
[junit4] 2> 55243 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
[junit4] 2> 55264 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
[junit4] 2> 55286 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 20
[junit4] 2> 55288 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
[junit4] 2> 55314 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
[junit4] 2> 55315 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
[junit4] 2> 55321 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 0
[junit4] 2> 55346 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0
[junit4] 2> 55347 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0
[junit4] 2> 55415 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 1
[junit4] 2> 55426 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[39]} 0 0
[junit4] 2> 55435 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[40]} 0 0
[junit4] 2> 55462 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[41]} 0 0
[junit4] 2> 55577 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[42]} 0 1
[junit4] 2> 55586 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[43]} 0 3
[junit4] 2> 55588 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[44]} 0 0
[junit4] 2> 55593 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45]} 0 0
[junit4] 2> 55597 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[46]} 0 0
[junit4] 2> 55600 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[47]} 0 0
[junit4] 2> 55602 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[48]} 0 0
[junit4] 2> 55606 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[49]} 0 0
[junit4] 2> 55608 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[50]} 0 0
[junit4] 2> 55646 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[51]} 0 31
[junit4] 2> 55647 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[52]} 0 0
[junit4] 2> 55670 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[53]} 0 0
[junit4] 2> 55678 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54]} 0 0
[junit4] 2> 55718 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[55]} 0 15
[junit4] 2> 55719 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[56]} 0 0
[junit4] 2> 55721 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[57]} 0 0
[junit4] 2> 55741 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[58]} 0 0HEARTBEAT J1 PID(11434@lucene1-us-west): 2017-11-02T17:59:44, stalled for 62.2s at: RecoveryAfterSoftCommitTest.test
[junit4]
[junit4] 2> 55743 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[59]} 0 0
[junit4] 2> 55760 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[60]} 0 0
[junit4] 2> 55775 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[61]} 0 0
[junit4] 2> 55798 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[62]} 0 0
[junit4] 2> 55800 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[63]} 0 0
[junit4] 2> 55825 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[64]} 0 0
[junit4] 2> 55827 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[65]} 0 0
[junit4] 2> 55847 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[66]} 0 0
[junit4] 2> 55848 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[67]} 0 0
[junit4] 2> 55875 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[68]} 0 0
[junit4] 2> 55877 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[69]} 0 0
[junit4] 2> 55895 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[70]} 0 0
[junit4] 2> 55917 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[71]} 0 0
[junit4] 2> 56031 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[72]} 0 0
[junit4] 2> 56034 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[73]} 0 0
[junit4] 2> 56038 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[74]} 0 0
[junit4] 2> 56039 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[75]} 0 0
[junit4] 2> 56043 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[76]} 0 0
[junit4] 2> 56044 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[77]} 0 0
[junit4] 2> 56048 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[78]} 0 0
[junit4] 2> 56049 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[79]} 0 0
[junit4] 2> 56051 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[80]} 0 0
[junit4] 2> 56139 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[81]} 0 0
[junit4] 2> 56160 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[82]} 0 0
[junit4] 2> 56179 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[83]} 0 0
[junit4] 2> 56225 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[84]} 0 0
[junit4] 2> 56248 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[85]} 0 0
[junit4] 2> 56250 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[86]} 0 0
[junit4] 2> 56315 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[87]} 0 0
[junit4] 2> 56346 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[88]} 0 12
[junit4] 2> 56347 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[89]} 0 0
[junit4] 2> 56379 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[90]} 0 0
[junit4] 2> 56387 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[91]} 0 0
[junit4] 2> 56407 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[92]} 0 0
[junit4] 2> 56449 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[93]} 0 0
[junit4] 2> 56644 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[94]} 0 0
[junit4] 2> 56646 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[95]} 0 0
[junit4] 2> 56651 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[96]} 0 0
[junit4] 2> 56653 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[97]} 0 0
[junit4] 2> 56658 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[98]} 0 0
[junit4] 2> 56662 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[99]} 0 0
[junit4] 2> 56664 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[100]} 0 0
[junit4] 2> 56674 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[101]} 0 0
[junit4] 2> 56686 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[102]} 0 0
[junit4] 2> 56687 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[103]} 0 0
[junit4] 2> 56713 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[104]} 0 3
[junit4] 2> 56794 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[105]} 0 0
[junit4] 2> 56834 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[106]} 0 0
[junit4] 2> 56835 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[107]} 0 0
[junit4] 2> 56836 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[108]} 0 0
[junit4] 2> 56870 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[109]} 0 8
[junit4] 2> 56871 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[110]} 0 0
[junit4] 2> 56895 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[111]} 0 0
[junit4] 2> 56922 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[112]} 0 0
[junit4] 2> 56944 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[113]} 0 0
[junit4] 2> 56945 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[114]} 0 0
[junit4] 2> 56965 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[115]} 0 0
[junit4] 2> 56967 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[116]} 0 0
[junit4] 2> 56968 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[117]} 0 0
[junit4] 2> 57063 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[118]} 0 0
[junit4] 2> 57090 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[119]} 0 0
[junit4] 2> 57101 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[120]} 0 7
[junit4] 2> 57106 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[121]} 0 0
[junit4] 2> 57122 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[122]} 0 0
[junit4] 2> 57123 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[123]} 0 0
[junit4] 2> 57125 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[124]} 0 0
[junit4] 2> 57142 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[125]} 0 0
[junit4] 2> 57161 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[126]} 0 0
[junit4] 2> 57650 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[127]} 0 468
[junit4] 2> 57653 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[128]} 0 1
[junit4] 2> 57657 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[129]} 0 0
[junit4] 2> 57658 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[130]} 0 0
[junit4] 2> 57664 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[131]} 0 0
[junit4] 2> 57666 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[132]} 0 0
[junit4] 2> 57667 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[133]} 0 0
[junit4] 2> 57672 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[134]} 0 0
[junit4] 2> 57674 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[135]} 0 0
[junit4] 2> 57676 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[136]} 0 0
[junit4] 2> 57678 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[137]} 0 0
[junit4] 2> 57679 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[138]} 0 0
[junit4] 2> 57684 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[139]} 0 0
[junit4] 2> 57703 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[140]} 0 0
[junit4] 2> 57722 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[141]} 0 0
[junit4] 2> 57762 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[142]} 0 1
[junit4] 2> 57792 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[143]} 0 17
[junit4] 2> 57841 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[144]} 0 10
[junit4] 2> 57908 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[145]} 0 0
[junit4] 2> 57909 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[146]} 0 0
[junit4] 2> 58026 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[147]} 0 3
[junit4] 2> 58028 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[148]} 0 0
[junit4] 2> 58402 INFO (qtp368937818-58) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[149]} 0 0
[junit4] 2> 58426 INFO (qtp368937818-58) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[150]} 0 0
[junit4] 2> 58448 INFO (qtp368937818-58) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[151]} 0 0
[junit4] 2> 58576 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[152]} 0 0
[junit4] 2> 58580 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[153]} 0 0
[junit4] 2> 58581 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[154]} 0 0
[junit4] 2> 58582 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[155]} 0 0
[junit4] 2> 58583 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[156]} 0 0
[junit4] 2> 58585 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[157]} 0 0
[junit4] 2> 58586 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[158]} 0 0
[junit4] 2> 58594 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[159]} 0 0
[junit4] 2> 58604 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[160]} 0 0
[junit4] 2> 58662 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[161]} 0 0
[junit4] 2> 58670 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[162]} 0 0
[junit4] 2> 58671 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[163]} 0 0
[junit4] 2> 58683 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[164]} 0 0
[junit4] 2> 58684 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[165]} 0 0
[junit4] 2> 58687 INFO (qtp368937818-62) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[166]} 0 0
[junit4] 2> 58698 INFO (qtp368937818-62) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[167]} 0 0
[junit4] 2> 58699 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[168]} 0 0
[junit4] 2> 58706 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[169]} 0 0
[junit4] 2> 58722 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[170]} 0 0
[junit4] 2> 58723 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[171]} 0 0
[junit4] 2> 58724 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[172]} 0 0
[junit4] 2> 58742 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[173]} 0 0
[junit4] 2> 58746 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[174]} 0 0
[junit4] 2> 58766 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[175]} 0 0
[junit4] 2> 58767 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[176]} 0 0
[junit4] 2> 58768 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[177]} 0 0
[junit4] 2> 58770 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[178]} 0 0
[junit4] 2> 58778 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[179]} 0 0
[junit4] 2> 58794 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[180]} 0 0
[junit4] 2> 58795 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[181]} 0 0
[junit4] 2> 58797 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[182]} 0 0
[junit4] 2> 58843 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[183]} 0 0
[junit4] 2> 58854 INFO (qtp368937818-61) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[184]} 0 0
[junit4] 2> 58855 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[185]} 0 0
[junit4] 2> 58866 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[186]} 0 0
[junit4] 2> 58876 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[187]} 0 0
[junit4] 2> 58894 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[188]} 0 0
[junit4] 2> 58926 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[189]} 0 0
[junit4] 2> 58950 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[190]} 0 0
[junit4] 2> 58952 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[191]} 0 0
[junit4] 2> 58953 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[192]} 0 0
[junit4] 2> 59065 INFO (qtp368937818-60) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[193]} 0 0
[junit4] 2> 59070 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[194]} 0 0
[junit4] 2> 59072 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[195]} 0 0
[junit4] 2> 59073 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[196]} 0 0
[junit4] 2> 59074 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[197]} 0 0
[junit4] 2> 59075 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[198]} 0 0
[junit4] 2> 59079 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[199]} 0 0
[junit4] 2> 59080 INFO (qtp368937818-57) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[200]} 0 0
[junit4] 2> 59082 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[201]} 0 0
[junit4] 2> 59083 INFO (qtp368937818-59) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=
[...truncated too long message...]
lave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptor-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/byte-buddy-1.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/commons-math3-3.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/hadoop-common-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/hadoop-hdfs-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/hadoop-minikdc-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jetty-sslengine-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/mockito-core-2.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/objenesis-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/analysis/icu/lucene-analyzers-icu-7.2.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/backward-codecs/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/contrib/analysis-extras/lib/icu4j-59.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_175330_4996638425270815196517.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_175330_4998331890759653604913.suites -stdin
[junit4] ERROR: JVM J2 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_175330_4994748419574583072258.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_175330_4991118246585240236198.syserr
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] at java.lang.Thread.run(Thread.java:748)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build.xml:262: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/common-build.xml:556: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1494: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1021: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J0-20171102_175330_4988369144358170874748.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J0-20171102_175330_4983526049869956840739.syserr
Total time: 187 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-7.x #203 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-7.x - Build # 211 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/211/
1 tests failed.
FAILED: org.apache.solr.update.TestInPlaceUpdatesDistrib.test
Error Message:
inplace_updatable_float didn't match for replica at client: http://127.0.0.1:52704/p_i/collection1 expected:<102.0> but was:<100.0>
Stack Trace:
java.lang.AssertionError: inplace_updatable_float didn't match for replica at client: http://127.0.0.1:52704/p_i/collection1 expected:<102.0> but was:<100.0>
at __randomizedtesting.SeedInfo.seed([11AB96A3345E3F88:99FFA9799AA25270]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.assertReplicaValue(TestInPlaceUpdatesDistrib.java:980)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.delayedReorderingFetchesMissingUpdateFromLeaderTest(TestInPlaceUpdatesDistrib.java:875)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.test(TestInPlaceUpdatesDistrib.java:145)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11836 lines...]
[junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J0-20171102_055109_3597858921678700759450.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # There is insufficient memory for the Java Runtime Environment to continue.
[junit4] # Native memory allocation (mmap) failed to map 12288 bytes for committing reserved memory.
[junit4] # An error report file with more information is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/hs_err_pid21297.log
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J0-20171102_055109_3595376073060507440173.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007febb1a77000, 12288, 0) failed; error='Cannot allocate memory' (errno=12)
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_055109_3789180389880341019725.sysout
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # There is insufficient memory for the Java Runtime Environment to continue.
[junit4] # Native memory allocation (mmap) failed to map 65536 bytes for committing reserved memory.
[junit4] # An error report file with more information is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/hs_err_pid21304.log
[junit4] #
[junit4] # Compiler replay data is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/replay_pid21304.log
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J2: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_055109_3782174312510314193276.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007f4dc70f0000, 65536, 1) failed; error='Cannot allocate memory' (errno=12)
[junit4] <<< JVM J2: EOF ----
[...truncated 1497 lines...]
[junit4] Suite: org.apache.solr.update.TestInPlaceUpdatesDistrib
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/init-core-data-001
[junit4] 2> 10117349 WARN (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
[junit4] 2> 10117349 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 10117351 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 10117351 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 10117351 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /p_i/
[junit4] 2> 10117351 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 10117351 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/lib, /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 10117371 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 10117417 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=inplace-updates
[junit4] 2> 10117420 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 10117447 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10117455 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10117455 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10117457 INFO (coreLoadExecutor-17852-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 10117457 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/lib, /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 10117487 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 10117510 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=inplace-updates
[junit4] 2> 10117513 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 10117513 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 10117514 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10117514 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 10117514 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/init-core-data-001/]
[junit4] 2> 10117528 WARN (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 10117561 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 10117561 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 10117562 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 10117562 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 10117563 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6381fd39[collection1] main]
[junit4] 2> 10117563 WARN (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 10117564 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 10117569 INFO (coreLoadExecutor-17852-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582942924311625728
[junit4] 2> 10117583 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[11AB96A3345E3F88]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 10117594 INFO (searcherExecutor-17853-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6381fd39[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 10117616 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 10117616 INFO (Thread-14459) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 10117616 INFO (Thread-14459) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 10117622 ERROR (Thread-14459) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 10117716 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.ZkTestServer start zk server on port:43782
[junit4] 2> 10117761 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 10117771 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/schema-inplace-updates.xml to /configs/conf1/schema.xml
[junit4] 2> 10117775 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 10117778 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 10117779 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 10117783 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 10117791 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 10117791 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 10117792 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 10117792 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 10117795 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 10117802 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 10118308 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 10118309 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1f052308{/p_i,null,AVAILABLE}
[junit4] 2> 10118309 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5cb74714{HTTP/1.1,[http/1.1]}{127.0.0.1:34843}
[junit4] 2> 10118309 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.Server Started @10142410ms
[junit4] 2> 10118309 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/tempDir-001/control/data, hostContext=/p_i, hostPort=34843, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/control-001/cores}
[junit4] 2> 10118310 ERROR (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 10118310 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 10118310 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 10118310 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 10118310 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-02T08:40:11.994Z
[junit4] 2> 10118391 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 10118391 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/control-001/solr.xml
[junit4] 2> 10118415 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 10118415 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 10118416 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 10118616 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43782/solr
[junit4] 2> 10118759 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:34843_p_i ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 10118760 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:34843_p_i ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34843_p_i
[junit4] 2> 10118760 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:34843_p_i ] o.a.s.c.Overseer Overseer (id=98933932772884484-127.0.0.1:34843_p_i-n_0000000000) starting
[junit4] 2> 10118786 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:34843_p_i ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34843_p_i
[junit4] 2> 10118810 INFO (OverseerStateUpdate-98933932772884484-127.0.0.1:34843_p_i-n_0000000000) [n:127.0.0.1:34843_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 10118949 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:34843_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10118959 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:34843_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10118960 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:34843_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10118961 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:34843_p_i ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/control-001/cores
[junit4] 2> 10119109 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 10119110 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43782/solr ready
[junit4] 2> 10119149 INFO (qtp1300348230-58946) [n:127.0.0.1:34843_p_i ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34843_p_i&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 10119198 INFO (OverseerThreadFactory-17865-thread-1-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 10119385 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 10119386 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 10119615 INFO (zkCallback-11425-thread-1-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 10120670 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 10120708 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=inplace-updates
[junit4] 2> 10120711 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 10120712 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 10120712 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10120712 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 10120712 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 10120728 WARN (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 10120822 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 10120823 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 10120824 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 10120824 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 10120830 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@67091989[control_collection_shard1_replica_n1] main]
[junit4] 2> 10120832 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 10120832 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 10120832 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 10120833 INFO (searcherExecutor-17868-thread-1-processing-n:127.0.0.1:34843_p_i x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@67091989[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 10120834 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582942927735226368
[junit4] 2> 10120837 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 10120837 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 10120838 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34843/p_i/control_collection_shard1_replica_n1/
[junit4] 2> 10120838 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 10120838 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:34843/p_i/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 10120838 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 10120840 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34843/p_i/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 10120940 INFO (zkCallback-11425-thread-2-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 10120951 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 10120952 INFO (qtp1300348230-58944) [n:127.0.0.1:34843_p_i c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1566
[junit4] 2> 10120958 INFO (qtp1300348230-58946) [n:127.0.0.1:34843_p_i ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 10121067 INFO (zkCallback-11425-thread-2-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 10121217 INFO (OverseerCollectionConfigSetProcessor-98933932772884484-127.0.0.1:34843_p_i-n_0000000000) [n:127.0.0.1:34843_p_i ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 10121959 INFO (qtp1300348230-58946) [n:127.0.0.1:34843_p_i ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34843_p_i&wt=javabin&version=2} status=0 QTime=2810
[junit4] 2> 10122243 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 10122244 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43782/solr ready
[junit4] 2> 10122244 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 10122246 INFO (qtp1300348230-58947) [n:127.0.0.1:34843_p_i ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 10122248 INFO (OverseerThreadFactory-17865-thread-2-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 10122262 WARN (OverseerThreadFactory-17865-thread-2-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 10122533 INFO (qtp1300348230-58947) [n:127.0.0.1:34843_p_i ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 10122533 INFO (qtp1300348230-58947) [n:127.0.0.1:34843_p_i ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=287
[junit4] 2> 10122629 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-1-001 of type TLOG
[junit4] 2> 10122629 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 10122630 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2145cbd7{/p_i,null,AVAILABLE}
[junit4] 2> 10122631 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@25050584{HTTP/1.1,[http/1.1]}{127.0.0.1:52704}
[junit4] 2> 10122631 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.Server Started @10146731ms
[junit4] 2> 10122631 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/p_i, hostPort=52704, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-1-001/cores}
[junit4] 2> 10122631 ERROR (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 10122631 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 10122631 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 10122631 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 10122632 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-02T08:40:16.316Z
[junit4] 2> 10122666 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 10122666 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-1-001/solr.xml
[junit4] 2> 10122669 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 10122670 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 10122687 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 10122739 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43782/solr
[junit4] 2> 10123167 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:52704_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 10123169 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:52704_p_i ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 10123172 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:52704_p_i ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52704_p_i
[junit4] 2> 10123173 INFO (zkCallback-11425-thread-2-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 10123177 INFO (zkCallback-11433-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 10123190 INFO (zkCallback-11438-thread-1-processing-n:127.0.0.1:52704_p_i) [n:127.0.0.1:52704_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 10123241 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:52704_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10123290 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:52704_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10123290 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:52704_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10123292 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:52704_p_i ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-1-001/cores
[junit4] 2> 10123402 INFO (qtp1300348230-58943) [n:127.0.0.1:34843_p_i ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:52704_p_i&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 10123404 INFO (OverseerCollectionConfigSetProcessor-98933932772884484-127.0.0.1:34843_p_i-n_0000000000) [n:127.0.0.1:34843_p_i ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 10123405 INFO (OverseerThreadFactory-17865-thread-3-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:52704_p_i for creating new replica
[junit4] 2> 10123448 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 10123449 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 10124738 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 10124864 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.s.IndexSchema [collection1_shard1_replica_t21] Schema name=inplace-updates
[junit4] 2> 10124888 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 10124888 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t21' using configuration from collection collection1, trusted=true
[junit4] 2> 10124888 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t21' (registry 'solr.core.collection1.shard1.replica_t21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10124888 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 10124888 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.SolrCore [[collection1_shard1_replica_t21] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-1-001/cores/collection1_shard1_replica_t21], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-1-001/cores/collection1_shard1_replica_t21/data/]
[junit4] 2> 10124920 WARN (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 10125083 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 10125083 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 10125084 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 10125085 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 10125095 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.s.SolrIndexSearcher Opening [Searcher@d6e2dd1[collection1_shard1_replica_t21] main]
[junit4] 2> 10125103 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 10125103 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 10125104 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 10125104 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582942932212645888
[junit4] 2> 10125107 INFO (searcherExecutor-17879-thread-1-processing-n:127.0.0.1:52704_p_i x:collection1_shard1_replica_t21 s:shard1 c:collection1) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.SolrCore [collection1_shard1_replica_t21] Registered new searcher Searcher@d6e2dd1[collection1_shard1_replica_t21] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 10125122 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 10125123 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 10125123 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:52704/p_i/collection1_shard1_replica_t21/
[junit4] 2> 10125123 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 10125123 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy http://127.0.0.1:52704/p_i/collection1_shard1_replica_t21/ has no replicas
[junit4] 2> 10125123 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 10125123 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.ZkController collection1_shard1_replica_t21 stopping background replication from leader
[junit4] 2> 10125125 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:52704/p_i/collection1_shard1_replica_t21/ shard1
[junit4] 2> 10125282 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 10125322 INFO (qtp1214615585-58993) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t21] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1874
[junit4] 2> 10125327 INFO (qtp1300348230-58943) [n:127.0.0.1:34843_p_i ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:52704_p_i&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1924
[junit4] 2> 10125418 INFO (OverseerCollectionConfigSetProcessor-98933932772884484-127.0.0.1:34843_p_i-n_0000000000) [n:127.0.0.1:34843_p_i ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 10125926 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-2-001 of type TLOG
[junit4] 2> 10125931 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 10125935 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5c17ef41{/p_i,null,AVAILABLE}
[junit4] 2> 10125935 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5c8be463{HTTP/1.1,[http/1.1]}{127.0.0.1:55972}
[junit4] 2> 10125935 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.Server Started @10150036ms
[junit4] 2> 10125935 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/p_i, hostPort=55972, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-2-001/cores}
[junit4] 2> 10125936 ERROR (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 10125936 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 10125936 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 10125936 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 10125936 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-02T08:40:19.620Z
[junit4] 2> 10125966 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 10125966 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-2-001/solr.xml
[junit4] 2> 10125969 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 10125969 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 10125994 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 10125999 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43782/solr
[junit4] 2> 10126065 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:55972_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 10126066 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:55972_p_i ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 10126068 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:55972_p_i ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55972_p_i
[junit4] 2> 10126068 INFO (zkCallback-11433-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 10126068 INFO (zkCallback-11438-thread-1-processing-n:127.0.0.1:52704_p_i) [n:127.0.0.1:52704_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 10126069 INFO (zkCallback-11425-thread-2-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 10126172 INFO (zkCallback-11444-thread-2-processing-n:127.0.0.1:55972_p_i) [n:127.0.0.1:55972_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 10126285 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:55972_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10126327 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:55972_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10126327 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:55972_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10126350 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:55972_p_i ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-2-001/cores
[junit4] 2> 10126454 INFO (qtp1300348230-58948) [n:127.0.0.1:34843_p_i ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:55972_p_i&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 10126457 INFO (OverseerThreadFactory-17865-thread-4-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:55972_p_i for creating new replica
[junit4] 2> 10126723 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 10126723 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 10127750 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 10127784 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.s.IndexSchema [collection1_shard1_replica_t23] Schema name=inplace-updates
[junit4] 2> 10127788 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 10127788 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t23' using configuration from collection collection1, trusted=true
[junit4] 2> 10127788 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t23' (registry 'solr.core.collection1.shard1.replica_t23') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10127788 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 10127788 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.c.SolrCore [[collection1_shard1_replica_t23] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-2-001/cores/collection1_shard1_replica_t23], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-2-001/cores/collection1_shard1_replica_t23/data/]
[junit4] 2> 10127808 WARN (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 10127923 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 10127923 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 10127924 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 10127924 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 10127934 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.s.SolrIndexSearcher Opening [Searcher@38216f4a[collection1_shard1_replica_t23] main]
[junit4] 2> 10127958 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 10127966 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 10127966 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 10127967 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582942935214718976
[junit4] 2> 10127969 INFO (searcherExecutor-17890-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.c.SolrCore [collection1_shard1_replica_t23] Registered new searcher Searcher@38216f4a[collection1_shard1_replica_t23] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 10128109 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_t23
[junit4] 2> 10128110 INFO (qtp850275847-59022) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t23] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1387
[junit4] 2> 10128112 INFO (updateExecutor-11441-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 10128114 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 10128117 INFO (qtp1300348230-58948) [n:127.0.0.1:34843_p_i ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:55972_p_i&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1663
[junit4] 2> 10128127 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 10128128 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.ZkController collection1_shard1_replica_t23 stopping background replication from leader
[junit4] 2> 10128128 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_t23]
[junit4] 2> 10128128 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 10128128 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_t23] as recovering, leader is [http://127.0.0.1:52704/p_i/collection1_shard1_replica_t21/] and I am [http://127.0.0.1:55972/p_i/collection1_shard1_replica_t23/]
[junit4] 2> 10128274 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:52704/p_i]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_t21&nodeName=127.0.0.1:55972_p_i&coreNodeName=core_node24&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 10128318 INFO (qtp1214615585-58991) [n:127.0.0.1:52704_p_i ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 10128327 INFO (qtp1214615585-58991) [n:127.0.0.1:52704_p_i ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_t21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:55972_p_i, coreNodeName=core_node24, onlyIfActiveCheckResult=false, nodeProps: core_node24:{"core":"collection1_shard1_replica_t23","base_url":"http://127.0.0.1:55972/p_i","node_name":"127.0.0.1:55972_p_i","state":"recovering","type":"TLOG"}
[junit4] 2> 10128327 INFO (qtp1214615585-58991) [n:127.0.0.1:52704_p_i ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 10128327 INFO (qtp1214615585-58991) [n:127.0.0.1:52704_p_i ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:55972_p_i&onlyIfLeaderActive=true&core=collection1_shard1_replica_t21&coreNodeName=core_node24&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 10128457 INFO (OverseerCollectionConfigSetProcessor-98933932772884484-127.0.0.1:34843_p_i-n_0000000000) [n:127.0.0.1:34843_p_i ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 10128564 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-3-001 of type TLOG
[junit4] 2> 10128564 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 10128567 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@42ef6093{/p_i,null,AVAILABLE}
[junit4] 2> 10128567 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7cfd0550{HTTP/1.1,[http/1.1]}{127.0.0.1:49944}
[junit4] 2> 10128568 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.e.j.s.Server Started @10152668ms
[junit4] 2> 10128568 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/p_i, hostPort=49944, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-3-001/cores}
[junit4] 2> 10128568 ERROR (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 10128568 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 10128568 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 10128568 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 10128568 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-02T08:40:22.252Z
[junit4] 2> 10128590 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 10128590 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-3-001/solr.xml
[junit4] 2> 10128593 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 10128593 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 10128631 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 10128633 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43782/solr
[junit4] 2> 10128682 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:49944_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 10128691 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:49944_p_i ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 10128695 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:49944_p_i ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49944_p_i
[junit4] 2> 10128696 INFO (zkCallback-11444-thread-2-processing-n:127.0.0.1:55972_p_i) [n:127.0.0.1:55972_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 10128696 INFO (zkCallback-11425-thread-2-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 10128702 INFO (zkCallback-11438-thread-1-processing-n:127.0.0.1:52704_p_i) [n:127.0.0.1:52704_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 10128702 INFO (zkCallback-11433-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 10128765 INFO (zkCallback-11451-thread-1-processing-n:127.0.0.1:49944_p_i) [n:127.0.0.1:49944_p_i ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 10128851 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
[junit4] 2> 10128851 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Attempting to replicate from [http://127.0.0.1:52704/p_i/collection1_shard1_replica_t21/].
[junit4] 2> 10128855 INFO (qtp1214615585-58997) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_t21] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1582942936145854464,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 10128893 INFO (qtp1214615585-58997) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_t21] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 10128895 INFO (qtp1214615585-58997) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_t21] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 10128895 INFO (qtp1214615585-58997) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_t21] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t21] webapp=/p_i path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2}{commit=} 0 39
[junit4] 2> 10128897 INFO (qtp1214615585-58997) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_t21] o.a.s.c.S.Request [collection1_shard1_replica_t21] webapp=/p_i path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 10128897 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 10128897 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 10128897 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 10128897 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 10128897 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 10128897 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 10128897 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@41ea0f10 commitCommandVersion:0
[junit4] 2> 10128910 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:49944_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10128952 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:49944_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10128952 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:49944_p_i ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d76f76
[junit4] 2> 10128954 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[11AB96A3345E3F88]) [n:127.0.0.1:49944_p_i ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.update.TestInPlaceUpdatesDistrib_11AB96A3345E3F88-001/shard-3-001/cores
[junit4] 2> 10128975 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.s.SolrIndexSearcher Opening [Searcher@498726d1[collection1_shard1_replica_t23] main]
[junit4] 2> 10128975 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 10128978 INFO (searcherExecutor-17890-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.SolrCore [collection1_shard1_replica_t23] Registered new searcher Searcher@498726d1[collection1_shard1_replica_t23] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 10128978 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Replication Recovery was successful.
[junit4] 2> 10128979 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
[junit4] 2> 10128979 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.ZkController collection1_shard1_replica_t23 starting background replication from leader
[junit4] 2> 10128979 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 10128986 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 10128986 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 10128987 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Updating version bucket highest from index after successful recovery.
[junit4] 2> 10128988 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582942936285315072
[junit4] 2> 10128989 INFO (recoveryExecutor-11442-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[true]
[junit4] 2> 10128990 INFO (indexFetcher-17902-thread-1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Updated masterUrl to http://127.0.0.1:52704/p_i/collection1_shard1_replica_t21/
[junit4] 2> 10128990 INFO (qtp1214615585-58997) [n:127.0.0.1:52704_p_i c:collection1 s:shard1 r:core_node22 x:collection1_shard1_replica_t21] o.a.s.c.S.Request [collection1_shard1_replica_t21] webapp=/p_i path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 10128990 INFO (indexFetcher-17902-thread-1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 10128990 INFO (indexFetcher-17902-thread-1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 10128990 INFO (indexFetcher-17902-thread-1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Slave's generation: 2
[junit4] 2> 10128990 INFO (indexFetcher-17902-thread-1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher Slave's version: 1509612022581
[junit4] 2> 10128990 INFO (indexFetcher-17902-thread-1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 10129327 INFO (qtp850275847-59020) [n:127.0.0.1:55972_p_i ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:49944_p_i&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 10129790 INFO (indexFetcher-17902-thread-1) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.s.SolrIndexSearcher Opening [Searcher@5e95a73[collection1_shard1_replica_t23] main]
[junit4] 2> 10129792 INFO (searcherExecutor-17890-thread-1-processing-n:127.0.0.1:55972_p_i x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:55972_p_i c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.SolrCore [collection1_shard1_replica_t23] Registered new searcher Searcher@5e95a73[collection1_shard1_replica_t23] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 10129793 INFO (OverseerThreadFactory-17865-thread-5-processing-n:127.0.0.1:34843_p_i) [n:127.0.0.1:34843_p_i ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:49944_p_i for creating new replica
[junit4] 2> 10129854 INFO (qtp2135421549-59056) [n:127.0.0.1:49944_p_i ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t25&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 10129854 INFO (qtp2135421549-59056) [n:127.0.0.1:49944_p_i ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 10130898 INFO (qtp2135421549-59056) [n:127.0.0.1:49944_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t25] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 10130908 INFO (qtp2135421549-59056) [n:127.0.0.1:49944_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t25] o.a.s.s.IndexSchema [collection1_shard1_replica_t25] Schema name=inplace-updates
[junit4] 2> 10130927 INFO (qtp2135421549-59056) [n:127.0.0.1:49944_p_i c:collection1 s:shard1 x:collection1_shard1_replica_t25] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 10130927 INFO (qtp2135421549-59056) [n:127.0.0.1:49944_p_i c:collection1 s:shard1 x:co
[...truncated too long message...]
ave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptor-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/byte-buddy-1.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/commons-math3-3.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/hadoop-common-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/hadoop-hdfs-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/hadoop-minikdc-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jetty-sslengine-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/mockito-core-2.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/test-lib/objenesis-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/analysis/icu/lucene-analyzers-icu-7.2.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/backward-codecs/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/contrib/analysis-extras/lib/icu4j-59.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_055109_3788080177834235890284.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_055109_3781678551227870739242.suites -stdin
[junit4] ERROR: JVM J2 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_055109_3789180389880341019725.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J2-20171102_055109_3782174312510314193276.syserr
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] at java.lang.Thread.run(Thread.java:748)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build.xml:262: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/common-build.xml:556: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1494: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1021: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J0-20171102_055109_3597858921678700759450.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/temp/junit4-J0-20171102_055109_3595376073060507440173.syserr
Total time: 324 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-7.x #203 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any