You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/10/01 12:38:36 UTC
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk-9) - Build # 220 -
Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/220/
Java: 64bit/jdk-9 -XX:+UseCompressedOops -XX:+UseSerialGC --illegal-access=deny
1 tests failed.
FAILED: org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
Error Message:
Can not find doc 1 in https://127.0.0.1:61117/solr
Stack Trace:
java.lang.AssertionError: Can not find doc 1 in https://127.0.0.1:61117/solr
at __randomizedtesting.SeedInfo.seed([52AE3736DB9F9EAD:D46FCFDB84CE484D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.TestTlogReplica.checkRTG(TestTlogReplica.java:861)
at org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates(TestTlogReplica.java:664)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12981 lines...]
[junit4] Suite: org.apache.solr.cloud.TestTlogReplica
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/init-core-data-001
[junit4] 2> 1992906 WARN (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
[junit4] 2> 1992911 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1992925 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1992927 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1992928 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001
[junit4] 2> 1992928 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1992929 INFO (Thread-2536) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1992929 INFO (Thread-2536) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1992933 ERROR (Thread-2536) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1993036 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:61114
[junit4] 2> 1993215 INFO (jetty-launcher-2019-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1993215 INFO (jetty-launcher-2019-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1993226 INFO (jetty-launcher-2019-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33a217a2{/solr,null,AVAILABLE}
[junit4] 2> 1993340 INFO (jetty-launcher-2019-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@750786f3{SSL,[ssl, http/1.1]}{127.0.0.1:۶۱۱۱۶}
[junit4] 2> 1993341 INFO (jetty-launcher-2019-thread-2) [ ] o.e.j.s.Server Started @۱۹۹۵۱۳۲ms
[junit4] 2> 1993341 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=61116}
[junit4] 2> 1993341 ERROR (jetty-launcher-2019-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1993341 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1993341 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1993341 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1993341 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-01T12:01:54.524934Z
[junit4] 2> 1993342 INFO (jetty-launcher-2019-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6a4a6e7d{/solr,null,AVAILABLE}
[junit4] 2> 1993397 INFO (jetty-launcher-2019-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4aa138d8{SSL,[ssl, http/1.1]}{127.0.0.1:۶۱۱۱۷}
[junit4] 2> 1993397 INFO (jetty-launcher-2019-thread-1) [ ] o.e.j.s.Server Started @۱۹۹۵۱۸۹ms
[junit4] 2> 1993397 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=61117}
[junit4] 2> 1993398 ERROR (jetty-launcher-2019-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1993398 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 1993398 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1993398 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1993398 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-01T12:01:54.581598Z
[junit4] 2> 1993400 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1993410 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1993426 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61114/solr
[junit4] 2> 1993426 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61114/solr
[junit4] 2> 1993738 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1993738 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1993739 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:61116_solr
[junit4] 2> 1993740 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61117_solr
[junit4] 2> 1993741 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98753532009840645-127.0.0.1:61116_solr-n_0000000000) starting
[junit4] 2> 1993742 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1993743 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1993756 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61116_solr
[junit4] 2> 1993758 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1993759 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1993932 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61117.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 1993949 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61116.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 1993956 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61117.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 1993957 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61117.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 1993969 INFO (jetty-launcher-2019-thread-1) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node1/.
[junit4] 2> 1993971 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61116.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 1993972 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61116.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 1993975 INFO (jetty-launcher-2019-thread-2) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node2/.
[junit4] 2> 1994092 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1994094 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61114/solr ready
[junit4] 2> 1994101 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
[junit4] 2> 1994126 INFO (qtp25251262-14983) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1994129 INFO (qtp25251262-14983) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1994144 INFO (TEST-TestTlogReplica.testDeleteById-seed#[52AE3736DB9F9EAD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteById
[junit4] 2> 1994148 INFO (qtp25251262-14984) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_delete_by_id&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1994155 INFO (OverseerThreadFactory-5607-thread-1) [ ] o.a.s.c.CreateCollectionCmd Create collection tlog_replica_test_delete_by_id
[junit4] 2> 1994275 INFO (OverseerStateUpdate-98753532009840645-127.0.0.1:61116_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_delete_by_id",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_delete_by_id_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:61117/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 1994281 INFO (OverseerStateUpdate-98753532009840645-127.0.0.1:61116_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_delete_by_id",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_delete_by_id_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:61116/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 1994501 INFO (qtp25251262-14979) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1994501 INFO (qtp25251262-14979) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1994518 INFO (qtp390379692-14992) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1994518 INFO (qtp390379692-14992) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1994642 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1994642 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1994643 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1994643 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1995557 INFO (qtp390379692-14992) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1995558 INFO (qtp25251262-14979) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1995582 INFO (qtp390379692-14992) [ ] o.a.s.s.IndexSchema [tlog_replica_test_delete_by_id_shard1_replica_t1] Schema name=minimal
[junit4] 2> 1995582 INFO (qtp25251262-14979) [ ] o.a.s.s.IndexSchema [tlog_replica_test_delete_by_id_shard1_replica_t2] Schema name=minimal
[junit4] 2> 1995586 INFO (qtp25251262-14979) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1995586 INFO (qtp25251262-14979) [ ] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_delete_by_id_shard1_replica_t2' using configuration from collection tlog_replica_test_delete_by_id, trusted=true
[junit4] 2> 1995586 INFO (qtp25251262-14979) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61116.solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 1995587 INFO (qtp25251262-14979) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1995587 INFO (qtp25251262-14979) [ ] o.a.s.c.SolrCore [[tlog_replica_test_delete_by_id_shard1_replica_t2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node2/tlog_replica_test_delete_by_id_shard1_replica_t2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node2/./tlog_replica_test_delete_by_id_shard1_replica_t2/data/]
[junit4] 2> 1995590 INFO (qtp390379692-14992) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1995590 INFO (qtp390379692-14992) [ ] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_delete_by_id_shard1_replica_t1' using configuration from collection tlog_replica_test_delete_by_id, trusted=true
[junit4] 2> 1995590 INFO (qtp390379692-14992) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61117.solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 1995590 INFO (qtp390379692-14992) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1995590 INFO (qtp390379692-14992) [ ] o.a.s.c.SolrCore [[tlog_replica_test_delete_by_id_shard1_replica_t1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node1/tlog_replica_test_delete_by_id_shard1_replica_t1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node1/./tlog_replica_test_delete_by_id_shard1_replica_t1/data/]
[junit4] 2> 1995661 INFO (qtp390379692-14992) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1995661 INFO (qtp390379692-14992) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1995663 INFO (qtp390379692-14992) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1995663 INFO (qtp390379692-14992) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1995668 INFO (qtp390379692-14992) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@586dcaba[tlog_replica_test_delete_by_id_shard1_replica_t1] main]
[junit4] 2> 1995669 INFO (qtp390379692-14992) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1995670 INFO (qtp390379692-14992) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1995671 INFO (qtp390379692-14992) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1995671 INFO (qtp390379692-14992) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580056515029499904
[junit4] 2> 1995672 INFO (searcherExecutor-5613-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] Registered new searcher Searcher@586dcaba[tlog_replica_test_delete_by_id_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1995678 INFO (qtp25251262-14979) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1995678 INFO (qtp25251262-14979) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1995679 INFO (qtp390379692-14992) [ ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 1995680 INFO (qtp25251262-14979) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1995680 INFO (qtp25251262-14979) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1995682 INFO (qtp25251262-14979) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7a3ebfc8[tlog_replica_test_delete_by_id_shard1_replica_t2] main]
[junit4] 2> 1995689 INFO (qtp25251262-14979) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1995690 INFO (qtp25251262-14979) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1995691 INFO (qtp25251262-14979) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1995691 INFO (qtp25251262-14979) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580056515050471424
[junit4] 2> 1995692 INFO (searcherExecutor-5612-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] Registered new searcher Searcher@7a3ebfc8[tlog_replica_test_delete_by_id_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1995790 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1995790 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1995790 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1995790 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1996184 INFO (qtp390379692-14992) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1996184 INFO (qtp390379692-14992) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1996184 INFO (qtp390379692-14992) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/
[junit4] 2> 1996185 INFO (qtp390379692-14992) [ ] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_delete_by_id_shard1_replica_t1 url=https://127.0.0.1:61117/solr START replicas=[https://127.0.0.1:61116/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/] nUpdates=100
[junit4] 2> 1996188 INFO (qtp25251262-14986) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1996489 INFO (qtp390379692-14992) [ ] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_delete_by_id_shard1_replica_t1 url=https://127.0.0.1:61117/solr DONE. We have no versions. sync failed.
[junit4] 2> 1996489 INFO (qtp390379692-14992) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1996489 INFO (qtp390379692-14992) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1996489 INFO (qtp390379692-14992) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1996490 INFO (qtp390379692-14992) [ ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t1 stopping background replication from leader
[junit4] 2> 1996494 INFO (qtp390379692-14992) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/ shard1
[junit4] 2> 1996618 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1996618 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1996618 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1996618 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1996669 INFO (qtp390379692-14992) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1996683 INFO (qtp390379692-14992) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2166
[junit4] 2> 1996706 INFO (qtp25251262-14979) [ ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t2 starting background replication from leader
[junit4] 2> 1996706 INFO (qtp25251262-14979) [ ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 1996707 INFO (qtp25251262-14979) [ ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 1996707 INFO (qtp25251262-14979) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1996707 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Replica core_node3 is leader but it's state is down, skipping replication
[junit4] 2> 1996709 INFO (qtp25251262-14979) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2208
[junit4] 2> 1996715 INFO (qtp25251262-14984) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1996843 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1996843 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1996843 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1996843 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1997716 INFO (qtp25251262-14984) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_delete_by_id&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=3568
[junit4] 2> 1997735 INFO (qtp25251262-14985) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1580056517182226432&distrib.from=https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&wt=javabin&version=2}{deleteByQuery=*:* (-1580056517182226432)} 0 1
[junit4] 2> 1997747 INFO (qtp25251262-14981) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 1997749 INFO (qtp390379692-14991) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580056517208440832,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1997749 INFO (qtp390379692-14991) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 1997749 INFO (qtp390379692-14991) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1997749 INFO (qtp390379692-14991) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 1997749 INFO (qtp390379692-14995) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:5&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1580056517182226432),commit=} 0 26
[junit4] 2> 1997755 INFO (qtp25251262-14981) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&wt=javabin&version=2}{add=[1 (1580056517211586560)]} 0 0
[junit4] 2> 1997755 INFO (qtp390379692-14992) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:5&wt=javabin&version=2}{add=[1 (1580056517211586560)]} 0 3
[junit4] 2> 1997761 INFO (qtp390379692-14994) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580056517221023744,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1997761 INFO (qtp390379692-14994) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1b002bab commitCommandVersion:1580056517221023744
[junit4] 2> 1997762 INFO (qtp25251262-14983) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 1997957 INFO (qtp390379692-14994) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@38111f6[tlog_replica_test_delete_by_id_shard1_replica_t1] main]
[junit4] 2> 1997957 INFO (qtp390379692-14994) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1997959 INFO (searcherExecutor-5613-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] Registered new searcher Searcher@38111f6[tlog_replica_test_delete_by_id_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C1)))}
[junit4] 2> 1997959 INFO (qtp390379692-14994) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 197
[junit4] 2> 1997960 INFO (qtp390379692-14993) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:5&commit=true&wt=javabin&version=2}{commit=} 0 199
[junit4] 2> 1997969 INFO (qtp390379692-14991) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 1997979 INFO (qtp25251262-14984) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998086 INFO (qtp25251262-14985) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998166 INFO (OverseerCollectionConfigSetProcessor-98753532009840645-127.0.0.1:61116_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1998188 INFO (qtp25251262-14982) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998290 INFO (qtp25251262-14982) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998399 INFO (qtp25251262-14983) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998504 INFO (qtp25251262-14986) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998606 INFO (qtp25251262-14979) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998709 INFO (qtp25251262-14984) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998818 INFO (qtp25251262-14985) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1998935 INFO (qtp25251262-14981) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1999073 INFO (qtp25251262-14981) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1999174 INFO (qtp25251262-14981) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1999285 INFO (qtp25251262-14986) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1999389 INFO (qtp25251262-14979) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1999498 INFO (qtp25251262-14984) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1999605 INFO (qtp25251262-14985) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1999708 INFO (qtp25251262-14982) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 1999709 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
[junit4] 2> 1999709 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/
[junit4] 2> 1999714 INFO (qtp390379692-14994) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1999715 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 1999715 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 1506859318945
[junit4] 2> 1999715 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 1999715 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 1999715 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 1999717 INFO (qtp390379692-14994) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=1
[junit4] 2> 1999717 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Number of files in latest index in master: 12
[junit4] 2> 1999721 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Starting download (fullCopy=true) to MockDirectoryWrapper(RAMDirectory@77accf47 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18fd02cf)
[junit4] 2> 1999735 INFO (qtp390379692-14988) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999743 INFO (qtp390379692-14995) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.mdvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999746 INFO (qtp390379692-14992) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999748 INFO (qtp390379692-14991) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999749 INFO (qtp390379692-14993) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.mdvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999751 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999752 INFO (qtp390379692-14994) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999753 INFO (qtp390379692-14988) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999754 INFO (qtp390379692-14995) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999755 INFO (qtp390379692-14992) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999756 INFO (qtp390379692-14991) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999757 INFO (qtp390379692-14993) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1999758 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=true,bytesDownloaded=1845) : 0 secs (null bytes/sec) to MockDirectoryWrapper(RAMDirectory@77accf47 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18fd02cf)
[junit4] 2> 1999758 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.c.SolrCore Updating index properties... index=index.20171001200200901
[junit4] 2> 1999760 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.h.IndexFetcher removing old index directory MockDirectoryWrapper(RAMDirectory@8df3aad lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7351f1f9)
[junit4] 2> 1999761 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 1999762 INFO (indexFetcher-5623-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@28eac473[tlog_replica_test_delete_by_id_shard1_replica_t2] main]
[junit4] 2> 1999763 INFO (searcherExecutor-5612-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] Registered new searcher Searcher@28eac473[tlog_replica_test_delete_by_id_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C1)))}
[junit4] 2> 1999809 INFO (qtp25251262-14982) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 1999812 INFO (qtp25251262-14986) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:61117/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&wt=javabin&version=2}{delete=[1 (-1580056519369555968)]} 0 0
[junit4] 2> 1999812 INFO (qtp390379692-14990) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={wt=javabin&version=2}{delete=[1 (-1580056519369555968)]} 0 2
[junit4] 2> 1999818 INFO (qtp390379692-14995) [ ] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/get params={distrib=false&qt=/get&id=1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1999819 INFO (TEST-TestTlogReplica.testDeleteById-seed#[52AE3736DB9F9EAD]) [ ] o.a.s.c.TestTlogReplica tearDown deleting collection
[junit4] 2> 1999819 INFO (qtp25251262-14984) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=tlog_replica_test_delete_by_id&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1999823 INFO (OverseerThreadFactory-5607-thread-2) [ ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 1999826 INFO (qtp25251262-14985) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, tag=null
[junit4] 2> 1999826 INFO (qtp25251262-14985) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1e40e91a: rootName = solr_61116, domain = solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, service url = null, agent id = null] for registry solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2 / com.codahale.metrics.MetricRegistry@45f838d9
[junit4] 2> 1999826 INFO (qtp390379692-14991) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, tag=null
[junit4] 2> 1999826 INFO (qtp390379692-14991) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2d966042: rootName = solr_61117, domain = solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, service url = null, agent id = null] for registry solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1 / com.codahale.metrics.MetricRegistry@6363ccbe
[junit4] 2> 1999841 INFO (qtp25251262-14985) [ ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t2 stopping background replication from leader
[junit4] 2> 1999841 INFO (qtp25251262-14985) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] CLOSING SolrCore org.apache.solr.core.SolrCore@5d744f1c
[junit4] 2> 1999842 INFO (qtp25251262-14985) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, tag=1567903516
[junit4] 2> 1999842 INFO (qtp25251262-14985) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.tlog_replica_test_delete_by_id.shard1.leader, tag=1567903516
[junit4] 2> 1999842 INFO (qtp25251262-14985) [ ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 1999842 INFO (qtp25251262-14985) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3d33c97c commitCommandVersion:0
[junit4] 2> 1999847 INFO (qtp390379692-14991) [ ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t1 stopping background replication from leader
[junit4] 2> 1999847 INFO (qtp390379692-14991) [ ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] CLOSING SolrCore org.apache.solr.core.SolrCore@7ebc2e6d
[junit4] 2> 1999847 INFO (qtp390379692-14991) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, tag=2126261869
[junit4] 2> 1999847 INFO (qtp390379692-14991) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.tlog_replica_test_delete_by_id.shard1.leader, tag=2126261869
[junit4] 2> 1999847 INFO (qtp390379692-14991) [ ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 1999847 INFO (qtp390379692-14991) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1b002bab commitCommandVersion:0
[junit4] 2> 1999850 INFO (qtp25251262-14985) [ ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 1999850 INFO (qtp25251262-14985) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=tlog_replica_test_delete_by_id_shard1_replica_t2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=24
[junit4] 2> 1999853 WARN (zkCallback-2030-thread-2) [ ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
[junit4] 2> 1999853 INFO (qtp390379692-14991) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=tlog_replica_test_delete_by_id_shard1_replica_t1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=27
[junit4] 2> 1999854 INFO (zkCallback-2037-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1999965 INFO (zkCallback-2037-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2000574 INFO (qtp25251262-14984) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=tlog_replica_test_delete_by_id&action=DELETE&wt=javabin&version=2} status=0 QTime=755
[junit4] 2> 2000575 INFO (TEST-TestTlogReplica.testDeleteById-seed#[52AE3736DB9F9EAD]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteById
[junit4] 2> 2000590 INFO (TEST-TestTlogReplica.testKillTlogReplica-seed#[52AE3736DB9F9EAD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testKillTlogReplica
[junit4] 2> 2000591 INFO (qtp25251262-14983) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_kill_tlog_replica&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2000596 INFO (OverseerThreadFactory-5607-thread-3) [ ] o.a.s.c.CreateCollectionCmd Create collection tlog_replica_test_kill_tlog_replica
[junit4] 2> 2000597 INFO (OverseerCollectionConfigSetProcessor-98753532009840645-127.0.0.1:61116_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2000819 INFO (OverseerStateUpdate-98753532009840645-127.0.0.1:61116_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_kill_tlog_replica",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_kill_tlog_replica_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:61117/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 2000823 INFO (OverseerStateUpdate-98753532009840645-127.0.0.1:61116_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_kill_tlog_replica",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_kill_tlog_replica_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:61116/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 2001028 INFO (qtp390379692-14990) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_tlog_replica_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_kill_tlog_replica&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 2001028 INFO (qtp25251262-14982) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_tlog_replica_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_kill_tlog_replica&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 2001149 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2001149 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2001149 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2001149 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002047 INFO (qtp390379692-14990) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2002047 INFO (qtp25251262-14982) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 2002072 INFO (qtp25251262-14982) [ ] o.a.s.s.IndexSchema [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] Schema name=minimal
[junit4] 2> 2002072 INFO (qtp390379692-14990) [ ] o.a.s.s.IndexSchema [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] Schema name=minimal
[junit4] 2> 2002073 INFO (qtp390379692-14990) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2002074 INFO (qtp390379692-14990) [ ] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_kill_tlog_replica_shard1_replica_t1' using configuration from collection tlog_replica_test_kill_tlog_replica, trusted=true
[junit4] 2> 2002073 INFO (qtp25251262-14982) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2002074 INFO (qtp25251262-14982) [ ] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_kill_tlog_replica_shard1_replica_t2' using configuration from collection tlog_replica_test_kill_tlog_replica, trusted=true
[junit4] 2> 2002074 INFO (qtp25251262-14982) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61116.solr.core.tlog_replica_test_kill_tlog_replica.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_kill_tlog_replica.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 2002074 INFO (qtp390379692-14990) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_61117.solr.core.tlog_replica_test_kill_tlog_replica.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_kill_tlog_replica.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@eb4ad81
[junit4] 2> 2002074 INFO (qtp25251262-14982) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2002074 INFO (qtp390379692-14990) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2002074 INFO (qtp25251262-14982) [ ] o.a.s.c.SolrCore [[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node2/tlog_replica_test_kill_tlog_replica_shard1_replica_t2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node2/./tlog_replica_test_kill_tlog_replica_shard1_replica_t2/data/]
[junit4] 2> 2002074 INFO (qtp390379692-14990) [ ] o.a.s.c.SolrCore [[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node1/tlog_replica_test_kill_tlog_replica_shard1_replica_t1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001/tempDir-001/node1/./tlog_replica_test_kill_tlog_replica_shard1_replica_t1/data/]
[junit4] 2> 2002187 INFO (qtp25251262-14982) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2002187 INFO (qtp25251262-14982) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2002189 INFO (qtp25251262-14982) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2002189 INFO (qtp25251262-14982) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2002194 INFO (qtp390379692-14990) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2002194 INFO (qtp390379692-14990) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2002194 INFO (qtp25251262-14982) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3635e491[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] main]
[junit4] 2> 2002197 INFO (qtp390379692-14990) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2002197 INFO (qtp390379692-14990) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2002199 INFO (qtp390379692-14990) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1cd3275a[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] main]
[junit4] 2> 2002200 INFO (qtp390379692-14990) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2002201 INFO (qtp390379692-14990) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2002201 INFO (qtp25251262-14982) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2002202 INFO (qtp25251262-14982) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2002202 INFO (qtp390379692-14990) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2002202 INFO (qtp390379692-14990) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580056521877749760
[junit4] 2> 2002203 INFO (qtp25251262-14982) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2002203 INFO (searcherExecutor-5625-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] Registered new searcher Searcher@1cd3275a[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2002203 INFO (searcherExecutor-5626-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] Registered new searcher Searcher@3635e491[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2002203 INFO (qtp25251262-14982) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580056521878798336
[junit4] 2> 2002216 INFO (qtp25251262-14982) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2002216 INFO (qtp25251262-14982) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2002216 INFO (qtp25251262-14982) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:61116/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/
[junit4] 2> 2002217 INFO (qtp25251262-14982) [ ] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_kill_tlog_replica_shard1_replica_t2 url=https://127.0.0.1:61116/solr START replicas=[https://127.0.0.1:61117/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t1/] nUpdates=100
[junit4] 2> 2002218 INFO (qtp390379692-14994) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2002326 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002326 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002326 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002326 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002517 INFO (qtp25251262-14982) [ ] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_kill_tlog_replica_shard1_replica_t2 url=https://127.0.0.1:61116/solr DONE. We have no versions. sync failed.
[junit4] 2> 2002517 INFO (qtp25251262-14982) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2002517 INFO (qtp25251262-14982) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2002517 INFO (qtp25251262-14982) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2002518 INFO (qtp25251262-14982) [ ] o.a.s.c.ZkController tlog_replica_test_kill_tlog_replica_shard1_replica_t2 stopping background replication from leader
[junit4] 2> 2002527 INFO (qtp25251262-14982) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:61116/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/ shard1
[junit4] 2> 2002638 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002639 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002639 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002639 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002688 INFO (qtp25251262-14982) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2002690 INFO (qtp25251262-14982) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_tlog_replica_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_kill_tlog_replica&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1661
[junit4] 2> 2002793 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002793 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002793 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2002793 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2003217 INFO (qtp390379692-14990) [ ] o.a.s.c.ZkController tlog_replica_test_kill_tlog_replica_shard1_replica_t1 starting background replication from leader
[junit4] 2> 2003217 INFO (qtp390379692-14990) [ ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 2003218 INFO (qtp390379692-14990) [ ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 2003218 INFO (qtp390379692-14990) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2003218 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:61116/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/
[junit4] 2> 2003219 INFO (qtp390379692-14990) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_kill_tlog_replica_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_kill_tlog_replica&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2191
[junit4] 2> 2003219 INFO (qtp25251262-14981) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2003220 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 2003220 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 2003220 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2003220 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 2003220 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
[junit4] 2> 2003220 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@10858a01[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] main]
[junit4] 2> 2003222 INFO (searcherExecutor-5625-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] Registered new searcher Searcher@10858a01[tlog_replica_test_kill_tlog_replica_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2003222 INFO (qtp25251262-14983) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2003326 INFO (zkCallback-2031-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2003326 INFO (zkCallback-2030-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2003326 INFO (zkCallback-2030-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2003326 INFO (zkCallback-2031-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_kill_tlog_replica/state.json] for collection [tlog_replica_test_kill_tlog_replica] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2004224 INFO (qtp25251262-14983) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_kill_tlog_replica&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=3632
[junit4] 2> 2004228 INFO (qtp390379692-14992) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004232 INFO (qtp25251262-14985) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004236 INFO (qtp390379692-14991) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:61116/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/&wt=javabin&version=2}{add=[1 (1580056524007407616)]} 0 0
[junit4] 2> 2004237 INFO (qtp25251262-14982) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1580056524007407616)]} 0 3
[junit4] 2> 2004238 INFO (qtp390379692-14990) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:61116/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 2004240 INFO (qtp25251262-14984) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580056524014747648,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2004240 INFO (qtp25251262-14984) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6ac653b1 commitCommandVersion:1580056524014747648
[junit4] 2> 2004247 INFO (qtp25251262-14984) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@644be577[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] main]
[junit4] 2> 2004247 INFO (qtp25251262-14984) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2004249 INFO (searcherExecutor-5626-thread-1) [ ] o.a.s.c.SolrCore [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] Registered new searcher Searcher@644be577[tlog_replica_test_kill_tlog_replica_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C1)))}
[junit4] 2> 2004249 INFO (qtp25251262-14984) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:61116/solr/tlog_replica_test_kill_tlog_replica_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 8
[junit4] 2> 2004249 INFO (qtp25251262-14983) [ ] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_kill_tlog_replica:6&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 11
[junit4] 2> 2004253 INFO (qtp390379692-14992) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004355 INFO (qtp390379692-14993) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004461 INFO (qtp390379692-14994) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004563 INFO (qtp390379692-14991) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004610 INFO (OverseerCollectionConfigSetProcessor-98753532009840645-127.0.0.1:61116_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2004669 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004774 INFO (qtp390379692-14988) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004880 INFO (qtp390379692-14995) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2004990 INFO (qtp390379692-14992) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005101 INFO (qtp390379692-14993) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005205 INFO (qtp390379692-14994) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005307 INFO (qtp390379692-14994) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005410 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005513 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005622 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005726 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005831 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2005941 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2006051 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=1
[junit4] 2> 2006160 INFO (qtp390379692-14990) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2006223 INFO (qtp25251262-14981) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 2006223 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 2006223 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 1506859325423
[junit4] 2> 2006223 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 2006223 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 2006223 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 2006224 INFO (qtp25251262-14982) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=0
[junit4] 2> 2006224 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Number of files in latest index in master: 15
[junit4] 2> 2006225 INFO (indexFetcher-5636-thread-1) [ ] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MockDirectoryWrapper(RAMDirectory@31977f75 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f8371de)
[junit4] 2> 2006225 INFO (qtp25251262-14979) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006226 INFO (qtp25251262-14986) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006228 INFO (qtp25251262-14985) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006229 INFO (qtp25251262-14984) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FST50_0.tfp&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006230 INFO (qtp25251262-14983) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006231 INFO (qtp25251262-14981) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006232 INFO (qtp25251262-14982) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FST50_0.pos&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006233 INFO (qtp25251262-14979) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.mdvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006234 INFO (qtp25251262-14986) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006235 INFO (qtp25251262-14985) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_FST50_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006235 INFO (qtp25251262-14984) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.mdvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006236 INFO (qtp25251262-14983) [ ] o.a.s.c.S.Request [tlog_replica_test_kill_tlog_replica_shard1_replica_t2] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 2006237 INFO (qtp25251262-14981) [ ] o.a.s.c
[...truncated too long message...]
xecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: CoreContainer is closed
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1143)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1110)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1066)
[junit4] 2> ... 7 more
[junit4] 2>
[junit4] 2> 2106097 WARN (zkCallback-2086-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2106097 INFO (jetty-closer-2020-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1537c28e{/solr,null,UNAVAILABLE}
[junit4] 2> 2106141 WARN (zkCallback-2059-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2106142 INFO (jetty-closer-2020-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5d2b1064{/solr,null,UNAVAILABLE}
[junit4] 2> 2106150 ERROR (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2106150 INFO (SUITE-TestTlogReplica-seed#[52AE3736DB9F9EAD]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:61114 61114
[junit4] 2> 2106189 INFO (Thread-2536) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:61114 61114
[junit4] 2> 2106519 WARN (Thread-2536) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 28 /solr/configs/conf
[junit4] 2> 10 /solr/aliases.json
[junit4] 2> 9 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 38 /solr/collections/tlog_replica_test_recovery/state.json
[junit4] 2> 36 /solr/collections/tlog_replica_test_create_delete/state.json
[junit4] 2> 27 /solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_remove_leader/state.json
[junit4] 2> 25 /solr/collections/tlog_replica_test_basic_leader_election/state.json
[junit4] 2> 24 /solr/collections/tlog_replica_test_kill_leader/state.json
[junit4] 2> 23 /solr/collections/tlog_replica_test_kill_tlog_replica/state.json
[junit4] 2> 19 /solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_real_time_get/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_only_leader_indexes/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_delete_by_id/state.json
[junit4] 2> 10 /solr/clusterprops.json
[junit4] 2> 10 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/tlog_replica_test_add_docs/state.json
[junit4] 2> 4 /solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/98753532009840657-core_node3-n_0000000000
[junit4] 2> 4 /solr/overseer_elect/election/98753532009840657-127.0.0.1:61117_solr-n_0000000004
[junit4] 2> 4 /solr/overseer_elect/election/98753532009840645-127.0.0.1:61116_solr-n_0000000000
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/98753532009840657-core_node16-n_0000000001
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/98753532009840669-core_node15-n_0000000001
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/98753532009840669-core_node3-n_0000000001
[junit4] 2> 2 /solr/collections/tlog_replica_test_kill_tlog_replica/leader_elect/shard1/election/98753532009840645-core_node4-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 10 /solr/collections
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_52AE3736DB9F9EAD-001
[junit4] 2> Oct 01, 2017 12:03:47 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {foo=FST50, id=PostingsFormat(name=Memory), foo_s=FST50}, docValues:{_version_=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=276, maxMBSortInHeap=6.57794482198277, sim=RandomSimilarity(queryNorm=false): {}, locale=pa-Arab, timezone=Asia/Taipei
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 (64-bit)/cpus=3,threads=1,free=146473064,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TestHttpShardHandlerFactory, TestTolerantSearch, IndexSchemaTest, ExplicitHLLTest, TestShardHandlerFactory, TestBulkSchemaConcurrent, TestReversedWildcardFilterFactory, TestIndexingPerformance, TestTrieFacet, LeaderInitiatedRecoveryOnCommitTest, BaseCdcrDistributedZkTest, ZkCLITest, TestSerializedLuceneMatchVersion, TestJmxIntegration, ConcurrentDeleteAndCreateCollectionTest, CdcrUpdateLogTest, TestPseudoReturnFields, RequiredFieldsTest, CoreAdminRequestStatusTest, LargeFieldTest, DateMathParserTest, TestCursorMarkWithoutUniqueKey, DeleteReplicaTest, TestPointFields, TestLeaderElectionWithEmptyReplica, TestConfigsApi, DateFieldTest, TestNonDefinedSimilarityFactory, SolrCloudReportersTest, ResourceLoaderTest, TestApiFramework, PeerSyncWithIndexFingerprintCachingTest, SharedFSAutoReplicaFailoverTest, ClassificationUpdateProcessorTest, TestNumericTerms64, DocExpirationUpdateProcessorFactoryTest, HttpPartitionTest, PeerSyncReplicationTest, TestNamedUpdateProcessors, URLClassifyProcessorTest, TestPolicyCloud, TestOnReconnectListenerSupport, PKIAuthenticationIntegrationTest, TestDynamicFieldCollectionResource, SolrTestCaseJ4Test, TestCloudInspectUtil, TestQuerySenderNoQuery, TestRecoveryHdfs, TestBlobHandler, TestCloudPivotFacet, TestCloudSchemaless, SyncSliceTest, AddBlockUpdateTest, TestAtomicUpdateErrorCases, ClusterStateTest, DistributedFacetExistsSmallTest, HdfsWriteToMultipleCollectionsTest, TestFieldCacheVsDocValues, BasicAuthIntegrationTest, SolrMetricManagerTest, TestSchemaSimilarityResource, PropertiesRequestHandlerTest, OutputWriterTest, TestManagedStopFilterFactory, V2StandaloneTest, TestUseDocValuesAsStored2, HighlighterTest, TestExactStatsCache, TestSort, TestSchemaNameResource, TestRandomDVFaceting, AtomicUpdateProcessorFactoryTest, TestGraphMLResponseWriter, TestConfigSetProperties, SimpleCollectionCreateDeleteTest, JSONWriterTest, ExitableDirectoryReaderTest, TestGroupingSearch, MigrateRouteKeyTest, TestRTimerTree, TestComplexPhraseLeadingWildcard, TestSchemalessBufferedUpdates, ConnectionReuseTest, ClassificationUpdateProcessorFactoryTest, ConnectionManagerTest, WrapperMergePolicyFactoryTest, LeaderFailoverAfterPartitionTest, TestCorePropertiesReload, CloudExitableDirectoryReaderTest, TestTolerantUpdateProcessorRandomCloud, UnloadDistributedZkTest, CurrencyFieldTypeTest, SliceStateTest, ManagedSchemaRoundRobinCloudTest, DefaultValueUpdateProcessorTest, TestLegacyField, SolrMetricsIntegrationTest, PeerSyncTest, TestIntervalFaceting, TestNRTOpen, CollectionStateFormat2Test, HighlighterConfigTest, TestManagedSchemaAPI, TestMultiValuedNumericRangeQuery, TestIBSimilarityFactory, DocValuesNotIndexedTest, TestJsonFacets, DocValuesTest, AnalysisAfterCoreReloadTest, SoftAutoCommitTest, CursorPagingTest, ClusterStateUpdateTest, SolrJmxReporterTest, TestWriterPerf, DirectUpdateHandlerTest, DocValuesMissingTest, TestXIncludeConfig, TestConfigOverlay, ChaosMonkeyNothingIsSafeTest, ShufflingReplicaListTransformerTest, ShardRoutingTest, BlobRepositoryCloudTest, SimplePostToolTest, UniqFieldsUpdateProcessorFactoryTest, TestStressInPlaceUpdates, TestTrackingShardHandlerFactory, ReplicationFactorTest, TestClassicSimilarityFactory, TestLMDirichletSimilarityFactory, DistributedFacetPivotLongTailTest, TestConfigSetsAPIExclusivity, TestManagedResourceStorage, SpellCheckCollatorWithCollapseTest, TestCryptoKeys, NodeMutatorTest, TestSmileRequest, TestImpersonationWithHadoopAuth, TestSolrQueryResponse, XmlUpdateRequestHandlerTest, TestHighlightDedupGrouping, CustomCollectionTest, MetricsConfigTest, DistributedFacetPivotSmallTest, TestPKIAuthenticationPlugin, TestLegacyNumericUtils, TestSSLRandomization, TestFilteredDocIdSet, VersionInfoTest, TestReqParamsAPI, CoreAdminHandlerTest, TestStressReorder, TestLockTree, TestCustomSort, BigEndianAscendingWordSerializerTest, BasicDistributedZkTest, RuleEngineTest, ResponseHeaderTest, TestCoreContainer, RequestLoggingTest, TestLeaderInitiatedRecoveryThread, TestPushWriter, InfoHandlerTest, AliasIntegrationTest, HdfsTlogReplayBufferedWhileIndexingTest, CSVRequestHandlerTest, TestSolrCoreProperties, TestMaxTokenLenTokenizer, TestZkAclsWithHadoopAuth, TestSha256AuthenticationProvider, TestQueryWrapperFilter, TestBulkSchemaAPI, TestTlogReplica]
[junit4] Completed [447/733 (1!)] on J0 in 114.17s, 13 tests, 1 failure <<< FAILURES!
[...truncated 40703 lines...]
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 225 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/225/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
All tests passed
Build Log:
[...truncated 60430 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/build.xml:826: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build.xml:669: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build.xml:682: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/common-build.xml:2570: exec returned: 1
Total time: 87 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 224 -
Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/224/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
19 tests failed.
FAILED: org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([E78A801B6608F367:5901E6B41F72FD52]:0)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.getNodeName(JettySolrRunner.java:345)
at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:66)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ClusterStateUpdateTest
Error Message:
28 threads leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: 1) Thread[id=16804, name=jetty-launcher-3706-thread-1-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 2) Thread[id=16828, name=zkCallback-3722-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=16825, name=zkCallback-3723-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=16832, name=zkCallback-3721-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=16809, name=OverseerStateUpdate-98764349772726280-127.0.0.1:51701_solr-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:407) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:133) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=16829, name=zkCallback-3722-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=16788, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=16833, name=zkCallback-3721-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 9) Thread[id=16827, name=zkCallback-3722-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=16787, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=16802, name=jetty-launcher-3706-thread-3-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 12) Thread[id=16800, name=jetty-launcher-3706-thread-2-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1246) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1170) 13) Thread[id=16808, name=zkCallback-3722-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 14) Thread[id=16805, name=jetty-launcher-3706-thread-1-EventThread, state=WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 15) Thread[id=16785, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 16) Thread[id=16810, name=OverseerCollectionConfigSetProcessor-98764349772726280-127.0.0.1:51701_solr-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354) at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:387) at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:193) at java.lang.Thread.run(Thread.java:748) 17) Thread[id=16789, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 18) Thread[id=16830, name=zkCallback-3723-thread-5, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 19) Thread[id=16803, name=jetty-launcher-3706-thread-3-EventThread, state=WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 20) Thread[id=16831, name=zkCallback-3721-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 21) Thread[id=16806, name=zkCallback-3723-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 22) Thread[id=16807, name=zkCallback-3721-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 23) Thread[id=16824, name=zkCallback-3723-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 24) Thread[id=16811, name=OverseerHdfsCoreFailoverThread-98764349772726280-127.0.0.1:51701_solr-n_0000000000, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread.java:748) 25) Thread[id=16786, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 26) Thread[id=16801, name=jetty-launcher-3706-thread-2-EventThread, state=WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 27) Thread[id=16826, name=zkCallback-3723-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 28) Thread[id=16790, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 28 threads leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest:
1) Thread[id=16804, name=jetty-launcher-3706-thread-1-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
2) Thread[id=16828, name=zkCallback-3722-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=16825, name=zkCallback-3723-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=16832, name=zkCallback-3721-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=16809, name=OverseerStateUpdate-98764349772726280-127.0.0.1:51701_solr-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:407)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:133)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=16829, name=zkCallback-3722-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=16788, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=16833, name=zkCallback-3721-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
9) Thread[id=16827, name=zkCallback-3722-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
10) Thread[id=16787, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
11) Thread[id=16802, name=jetty-launcher-3706-thread-3-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
12) Thread[id=16800, name=jetty-launcher-3706-thread-2-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1246)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1170)
13) Thread[id=16808, name=zkCallback-3722-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
14) Thread[id=16805, name=jetty-launcher-3706-thread-1-EventThread, state=WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
15) Thread[id=16785, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
16) Thread[id=16810, name=OverseerCollectionConfigSetProcessor-98764349772726280-127.0.0.1:51701_solr-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:387)
at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:193)
at java.lang.Thread.run(Thread.java:748)
17) Thread[id=16789, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
18) Thread[id=16830, name=zkCallback-3723-thread-5, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
19) Thread[id=16803, name=jetty-launcher-3706-thread-3-EventThread, state=WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
20) Thread[id=16831, name=zkCallback-3721-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21) Thread[id=16806, name=zkCallback-3723-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
22) Thread[id=16807, name=zkCallback-3721-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
23) Thread[id=16824, name=zkCallback-3723-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
24) Thread[id=16811, name=OverseerHdfsCoreFailoverThread-98764349772726280-127.0.0.1:51701_solr-n_0000000000, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
at java.lang.Thread.run(Thread.java:748)
25) Thread[id=16786, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
26) Thread[id=16801, name=jetty-launcher-3706-thread-2-EventThread, state=WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
27) Thread[id=16826, name=zkCallback-3723-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
28) Thread[id=16790, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([E78A801B6608F367]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ClusterStateUpdateTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=16804, name=jetty-launcher-3706-thread-1-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 2) Thread[id=16828, name=zkCallback-3722-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=16825, name=zkCallback-3723-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=16830, name=zkCallback-3723-thread-5, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=16832, name=zkCallback-3721-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=16831, name=zkCallback-3721-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=16806, name=zkCallback-3723-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=16807, name=zkCallback-3721-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 9) Thread[id=16824, name=zkCallback-3723-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=16829, name=zkCallback-3722-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=16833, name=zkCallback-3721-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 12) Thread[id=16827, name=zkCallback-3722-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 13) Thread[id=16802, name=jetty-launcher-3706-thread-3-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 14) Thread[id=16826, name=zkCallback-3723-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 15) Thread[id=16800, name=jetty-launcher-3706-thread-2-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 16) Thread[id=16808, name=zkCallback-3722-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=16804, name=jetty-launcher-3706-thread-1-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
2) Thread[id=16828, name=zkCallback-3722-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=16825, name=zkCallback-3723-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=16830, name=zkCallback-3723-thread-5, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=16832, name=zkCallback-3721-thread-3, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=16831, name=zkCallback-3721-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=16806, name=zkCallback-3723-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=16807, name=zkCallback-3721-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
9) Thread[id=16824, name=zkCallback-3723-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
10) Thread[id=16829, name=zkCallback-3722-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
11) Thread[id=16833, name=zkCallback-3721-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
12) Thread[id=16827, name=zkCallback-3722-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
13) Thread[id=16802, name=jetty-launcher-3706-thread-3-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
14) Thread[id=16826, name=zkCallback-3723-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
15) Thread[id=16800, name=jetty-launcher-3706-thread-2-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
16) Thread[id=16808, name=zkCallback-3722-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([E78A801B6608F367]:0)
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
Stack Trace:
org.apache.solr.common.SolrException: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:171)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:117)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:112)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:99)
at org.apache.solr.cloud.AbstractDistribZkTestBase.printLayout(AbstractDistribZkTestBase.java:323)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:660)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1842)
at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447)
at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
at org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43)
at org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105)
at org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:146)
... 47 more
Caused by: java.io.IOException: Too many open files
at sun.nio.ch.IOUtil.makePipe(Native Method)
at sun.nio.ch.KQueueSelectorImpl.<init>(KQueueSelectorImpl.java:84)
at sun.nio.ch.KQueueSelectorProvider.openSelector(KQueueSelectorProvider.java:42)
at java.nio.channels.Selector.open(Selector.java:227)
at org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43)
at sun.reflect.GeneratedConstructorAccessor130.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at java.lang.Class.newInstance(Class.java:442)
at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1839)
... 53 more
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
IOException occured when talking to server at: http://127.0.0.1:51573/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:51573/solr/collection1
at __randomizedtesting.SeedInfo.seed([E78A801B6608F367:3C2180DD63209AD4]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:641)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:850)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Too many open files
at java.net.Socket.createImpl(Socket.java:460)
at java.net.Socket.getImpl(Socket.java:520)
at java.net.Socket.setSoTimeout(Socket.java:1141)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:120)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
... 46 more
FAILED: org.apache.solr.handler.TestReplicationHandler.testRateLimitedReplication
Error Message:
IOException occured when talking to server at: http://127.0.0.1:51576/solr/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:51576/solr/collection1
at __randomizedtesting.SeedInfo.seed([E78A801B6608F367:611EF5EE69BA728A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:641)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
at org.apache.solr.handler.TestReplicationHandler.testRateLimitedReplication(TestReplicationHandler.java:1382)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Too many open files
at java.net.Socket.createImpl(Socket.java:460)
at java.net.Socket.getImpl(Socket.java:520)
at java.net.Socket.setSoTimeout(Socket.java:1141)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:120)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
... 46 more
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterStartup
Error Message:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E78A801B6608F367-001/solr-instance-006/collection1/core.properties: Too many open files
Stack Trace:
java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E78A801B6608F367-001/solr-instance-006/collection1/core.properties: Too many open files
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
at java.nio.file.Files.newOutputStream(Files.java:216)
at org.apache.solr.SolrTestCaseJ4.writeCoreProperties(SolrTestCaseJ4.java:200)
at org.apache.solr.handler.TestReplicationHandler$SolrInstance.setUp(TestReplicationHandler.java:1628)
at org.apache.solr.handler.TestReplicationHandler.setUp(TestReplicationHandler.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestRepeater
Error Message:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E78A801B6608F367-001/solr-instance-008/collection1/core.properties: Too many open files
Stack Trace:
java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_E78A801B6608F367-001/solr-instance-008/collection1/core.properties: Too many open files
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
at java.nio.file.Files.newOutputStream(Files.java:216)
at org.apache.solr.SolrTestCaseJ4.writeCoreProperties(SolrTestCaseJ4.java:200)
at org.apache.solr.handler.TestReplicationHandler$SolrInstance.setUp(TestReplicationHandler.java:1628)
at org.apache.solr.handler.TestReplicationHandler.setUp(TestReplicationHandler.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:
[...truncated too long message...]
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 8) Thread[id=16807, name=zkCallback-3721-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 9) Thread[id=16824, name=zkCallback-3723-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 10) Thread[id=16829, name=zkCallback-3722-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 11) Thread[id=16833, name=zkCallback-3721-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 12) Thread[id=16827, name=zkCallback-3722-thread-2, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 13) Thread[id=16802, name=jetty-launcher-3706-thread-3-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
[junit4] > 14) Thread[id=16826, name=zkCallback-3723-thread-4, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 15) Thread[id=16800, name=jetty-launcher-3706-thread-2-SendThread(127.0.0.1:51698), state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 16) Thread[id=16808, name=zkCallback-3722-thread-1, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([E78A801B6608F367]:0)
[junit4] Completed [373/733 (3!)] on J0 in 24.55s, 1 test, 3 errors <<< FAILURES!
[...truncated 47655 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/build.xml:826: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build.xml:669: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build.xml:682: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/common-build.xml:2570: exec returned: 1
Total time: 74 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk-9) - Build # 223 -
Still unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/223/
Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseG1GC --illegal-access=deny
1 tests failed.
FAILED: org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testExecutorStream
Error Message:
Error from server at https://127.0.0.1:56976/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason: <pre> Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:56976/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason:
<pre> Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([89BF67B7CD937318:AB7FE64CEEF95908]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testExecutorStream(StreamExpressionTest.java:7471)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:56976/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason:
<pre> Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
... 1 more
Build Log:
[...truncated 14844 lines...]
[junit4] Suite: org.apache.solr.client.solrj.io.stream.StreamExpressionTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/init-core-data-001
[junit4] 2> 117928 WARN (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 117928 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 117928 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 117929 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 117929 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001
[junit4] 2> 117929 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 117930 INFO (Thread-397) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 117930 INFO (Thread-397) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 117932 ERROR (Thread-397) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 118041 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:56970
[junit4] 2> 118077 INFO (jetty-launcher-889-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 118077 INFO (jetty-launcher-889-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 118077 INFO (jetty-launcher-889-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 118080 INFO (jetty-launcher-889-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 118083 INFO (jetty-launcher-889-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@24cb4288{/solr,null,AVAILABLE}
[junit4] 2> 118086 INFO (jetty-launcher-889-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@225ab1bf{/solr,null,AVAILABLE}
[junit4] 2> 118087 INFO (jetty-launcher-889-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@36f5816a{SSL,[ssl, http/1.1]}{127.0.0.1:56972}
[junit4] 2> 118087 INFO (jetty-launcher-889-thread-2) [ ] o.e.j.s.Server Started @121314ms
[junit4] 2> 118087 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=56972}
[junit4] 2> 118087 INFO (jetty-launcher-889-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5f9e6873{SSL,[ssl, http/1.1]}{127.0.0.1:56973}
[junit4] 2> 118087 INFO (jetty-launcher-889-thread-3) [ ] o.e.j.s.Server Started @121315ms
[junit4] 2> 118087 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=56973}
[junit4] 2> 118087 ERROR (jetty-launcher-889-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 118088 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 118088 ERROR (jetty-launcher-889-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 118088 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 118088 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 118088 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T22:57:38.546462Z
[junit4] 2> 118088 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 118088 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 118088 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 118088 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T22:57:38.546819Z
[junit4] 2> 118092 INFO (jetty-launcher-889-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d0ef707{/solr,null,AVAILABLE}
[junit4] 2> 118092 INFO (jetty-launcher-889-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5e7ee8e1{/solr,null,AVAILABLE}
[junit4] 2> 118093 INFO (jetty-launcher-889-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@9c15975{SSL,[ssl, http/1.1]}{127.0.0.1:56975}
[junit4] 2> 118093 INFO (jetty-launcher-889-thread-1) [ ] o.e.j.s.Server Started @121321ms
[junit4] 2> 118094 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=56975}
[junit4] 2> 118094 INFO (jetty-launcher-889-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7838d904{SSL,[ssl, http/1.1]}{127.0.0.1:56976}
[junit4] 2> 118094 ERROR (jetty-launcher-889-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 118094 INFO (jetty-launcher-889-thread-4) [ ] o.e.j.s.Server Started @121321ms
[junit4] 2> 118094 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=56976}
[junit4] 2> 118094 ERROR (jetty-launcher-889-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 118095 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 118095 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 118095 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 118095 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T22:57:38.553215Z
[junit4] 2> 118095 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 118095 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 118095 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 118095 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T22:57:38.553549Z
[junit4] 2> 118102 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 118103 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 118104 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 118105 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 118117 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56970/solr
[junit4] 2> 118117 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56970/solr
[junit4] 2> 118118 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56970/solr
[junit4] 2> 118120 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15edf4f20550006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 118121 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56970/solr
[junit4] 2> 118126 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15edf4f20550009, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 118154 WARN (jetty-launcher-889-thread-3) [ ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 118156 WARN (jetty-launcher-889-thread-2) [ ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 118156 WARN (jetty-launcher-889-thread-4) [ ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 118157 WARN (jetty-launcher-889-thread-1) [ ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 118165 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 118165 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 118165 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 118166 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:56975_solr
[junit4] 2> 118167 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56973_solr
[junit4] 2> 118167 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 118168 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56976_solr
[junit4] 2> 118169 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98761772786581516-127.0.0.1:56975_solr-n_0000000000) starting
[junit4] 2> 118170 INFO (zkCallback-911-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 118171 INFO (zkCallback-907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 118171 INFO (zkCallback-910-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 118171 INFO (zkCallback-909-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 118177 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56972_solr
[junit4] 2> 118181 INFO (zkCallback-910-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 118181 INFO (zkCallback-907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 118182 INFO (zkCallback-911-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 118182 INFO (zkCallback-909-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 118201 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56975_solr
[junit4] 2> 118203 INFO (zkCallback-910-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 118204 INFO (zkCallback-907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 118204 INFO (zkCallback-911-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 118204 INFO (zkCallback-909-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 118253 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56976.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118263 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56976.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118275 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56975.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118279 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56976.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118280 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56972.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118284 INFO (jetty-launcher-889-thread-4) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001/node4/.
[junit4] 2> 118319 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56973.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118319 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56972.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118320 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56972.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118320 WARN (jetty-launcher-889-thread-1) [ ] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge
[junit4] 2> javax.management.InstanceNotFoundException: solr_56975:dom1=solr,dom2=jvm,name0=os,name=committedVirtualMemorySize
[junit4] 2> at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083)
[junit4] 2> at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423)
[junit4] 2> at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411)
[junit4] 2> at java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:530)
[junit4] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:565)
[junit4] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.lambda$start$0(JmxMetricsReporter.java:738)
[junit4] 2> at java.base/java.util.HashMap.forEach(HashMap.java:1340)
[junit4] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:728)
[junit4] 2> at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:109)
[junit4] 2> at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70)
[junit4] 2> at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:849)
[junit4] 2> at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:817)
[junit4] 2> at org.apache.solr.core.CoreContainer.load(CoreContainer.java:544)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:263)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:183)
[junit4] 2> at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1596)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1659)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1316)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1145)
[junit4] 2> at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
[junit4] 2> at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:384)
[junit4] 2> at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:247)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 118324 INFO (jetty-launcher-889-thread-2) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001/node2/.
[junit4] 2> 118334 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56975.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118334 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56975.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118338 INFO (jetty-launcher-889-thread-1) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001/node1/.
[junit4] 2> 118344 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56973.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118344 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56973.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 118345 INFO (jetty-launcher-889-thread-3) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001/node3/.
[junit4] 2> 118456 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 118457 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:56970/solr ready
[junit4] 2> 118480 INFO (qtp1454681523-2707) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 118481 INFO (OverseerThreadFactory-895-thread-1) [ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 118606 INFO (OverseerStateUpdate-98761772786581516-127.0.0.1:56975_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56976/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 118609 INFO (OverseerStateUpdate-98761772786581516-127.0.0.1:56975_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56972/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 118829 INFO (qtp1454681523-2701) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 118829 INFO (qtp1454681523-2701) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 118835 INFO (qtp783533656-2697) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard2_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 118835 INFO (qtp783533656-2697) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 118942 INFO (zkCallback-907-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 118942 INFO (zkCallback-910-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 118942 INFO (zkCallback-910-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 118943 INFO (zkCallback-907-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 119848 INFO (qtp1454681523-2701) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 119863 INFO (qtp783533656-2697) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 119864 INFO (qtp1454681523-2701) [ ] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=test
[junit4] 2> 119918 INFO (qtp783533656-2697) [ ] o.a.s.s.IndexSchema [collection1_shard2_replica_n2] Schema name=test
[junit4] 2> 119991 WARN (qtp1454681523-2701) [ ] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 119991 WARN (qtp1454681523-2701) [ ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 119991 INFO (qtp1454681523-2701) [ ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 119991 INFO (qtp1454681523-2701) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from collection collection1, trusted=true
[junit4] 2> 119992 INFO (qtp1454681523-2701) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56976.solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 119992 INFO (qtp1454681523-2701) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 119992 INFO (qtp1454681523-2701) [ ] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001/node4/collection1_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001/node4/./collection1_shard1_replica_n1/data/]
[junit4] 2> 120040 WARN (qtp783533656-2697) [ ] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 120040 WARN (qtp783533656-2697) [ ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 120040 INFO (qtp783533656-2697) [ ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 120040 INFO (qtp783533656-2697) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n2' using configuration from collection collection1, trusted=true
[junit4] 2> 120040 INFO (qtp783533656-2697) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_56972.solr.core.collection1.shard2.replica_n2' (registry 'solr.core.collection1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21028236
[junit4] 2> 120040 INFO (qtp783533656-2697) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 120040 INFO (qtp783533656-2697) [ ] o.a.s.c.SolrCore [[collection1_shard2_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001/node2/collection1_shard2_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001/tempDir-001/node2/./collection1_shard2_replica_n2/data/]
[junit4] 2> 120119 INFO (qtp1454681523-2701) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 120119 INFO (qtp1454681523-2701) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 120121 INFO (qtp1454681523-2701) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 120121 INFO (qtp1454681523-2701) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 120133 INFO (qtp1454681523-2701) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@d0e2376[collection1_shard1_replica_n1] main]
[junit4] 2> 120136 INFO (qtp1454681523-2701) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 120139 INFO (qtp1454681523-2701) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 120140 INFO (qtp1454681523-2701) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 120140 INFO (qtp1454681523-2701) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580188366901608448
[junit4] 2> 120140 INFO (searcherExecutor-904-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@d0e2376[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 120153 INFO (qtp1454681523-2701) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 120153 INFO (qtp1454681523-2701) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 120153 INFO (qtp1454681523-2701) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/
[junit4] 2> 120154 INFO (qtp1454681523-2701) [ ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 120154 INFO (qtp1454681523-2701) [ ] o.a.s.c.SyncStrategy https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/ has no replicas
[junit4] 2> 120154 INFO (qtp1454681523-2701) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 120158 INFO (qtp1454681523-2701) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/ shard1
[junit4] 2> 120177 INFO (qtp783533656-2697) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 120177 INFO (qtp783533656-2697) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 120178 INFO (qtp783533656-2697) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 120178 INFO (qtp783533656-2697) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 120190 INFO (qtp783533656-2697) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@17fef66f[collection1_shard2_replica_n2] main]
[junit4] 2> 120191 INFO (qtp783533656-2697) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 120192 INFO (qtp783533656-2697) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 120192 INFO (qtp783533656-2697) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 120192 INFO (qtp783533656-2697) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580188366956134400
[junit4] 2> 120193 INFO (searcherExecutor-905-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher Searcher@17fef66f[collection1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 120199 INFO (qtp783533656-2697) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 120199 INFO (qtp783533656-2697) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 120199 INFO (qtp783533656-2697) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/
[junit4] 2> 120199 INFO (qtp783533656-2697) [ ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 120199 INFO (qtp783533656-2697) [ ] o.a.s.c.SyncStrategy https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/ has no replicas
[junit4] 2> 120199 INFO (qtp783533656-2697) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 120203 INFO (qtp783533656-2697) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/ shard2
[junit4] 2> 120307 INFO (zkCallback-907-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 120307 INFO (zkCallback-910-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 120307 INFO (zkCallback-910-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 120307 INFO (zkCallback-907-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 120310 INFO (qtp1454681523-2701) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 120312 INFO (qtp1454681523-2701) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1482
[junit4] 2> 120356 INFO (qtp783533656-2697) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 120362 INFO (qtp783533656-2697) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard2_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1526
[junit4] 2> 120375 INFO (qtp1454681523-2707) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 120473 INFO (zkCallback-907-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 120473 INFO (zkCallback-907-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 120473 INFO (zkCallback-910-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 120473 INFO (zkCallback-910-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 120485 INFO (OverseerCollectionConfigSetProcessor-98761772786581516-127.0.0.1:56975_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 121382 INFO (qtp1454681523-2707) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=2902
[junit4] 2> 121382 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):90
[junit4] 2> 121384 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
[junit4] 2> 121424 INFO (TEST-StreamExpressionTest.testBinomialDistribution-seed#[89BF67B7CD937318]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBinomialDistribution
[junit4] 2> 121436 INFO (qtp783533656-2700) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&wt=javabin&version=2}{deleteByQuery=*:* (-1580188368259514368)} 0 1
[junit4] 2> 121441 INFO (qtp783533656-2693) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368265805824,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121441 INFO (qtp783533656-2693) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 121442 INFO (qtp783533656-2693) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121442 INFO (qtp783533656-2693) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 1
[junit4] 2> 121443 INFO (qtp1454681523-2705) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368267902976,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121443 INFO (qtp1454681523-2705) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 121444 INFO (qtp1454681523-2705) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121444 INFO (qtp1454681523-2705) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 121445 INFO (qtp1454681523-2704) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=collection1:4&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1580188368251125760),commit=} 0 18
[junit4] 2> 121457 INFO (qtp2019914718-2722) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 121464 INFO (qtp783533656-2697) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/stream params={indent=off&expr=let(a%3DbinomialDistribution(100,+.50),+++++++++++++++b%3Dsample(a,+10000),+++++++++++++++tuple(d%3Ddescribe(b),++++++++++++++++++++++p%3Dprobability(a,+50),++++++++++++++++++++++c%3DcumulativeProbability(a,+50)))&wt=json&version=2.2} status=0 QTime=2
[junit4] 2> 121683 INFO (TEST-StreamExpressionTest.testBinomialDistribution-seed#[89BF67B7CD937318]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBinomialDistribution
[junit4] 2> 121706 INFO (TEST-StreamExpressionTest.testCorrelationStream-seed#[89BF67B7CD937318]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCorrelationStream
[junit4] 2> 121729 INFO (qtp783533656-2698) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&wt=javabin&version=2}{deleteByQuery=*:* (-1580188368545775616)} 0 21
[junit4] 2> 121731 INFO (qtp783533656-2699) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368569892864,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121731 INFO (qtp1454681523-2701) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368569892864,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121731 INFO (qtp783533656-2699) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 121731 INFO (qtp1454681523-2701) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 121731 INFO (qtp1454681523-2701) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121731 INFO (qtp783533656-2699) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121731 INFO (qtp1454681523-2701) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 121731 INFO (qtp783533656-2699) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 121732 INFO (qtp1454681523-2710) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=collection1:4&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1580188368544727040),commit=} 0 25
[junit4] 2> 121766 INFO (qtp1454681523-2707) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=collection1:4&wt=javabin&version=2}{add=[id_2 (1580188368577232896), id_10 (1580188368588767232), id_13 (1580188368588767233), id_14 (1580188368589815808), id_16 (1580188368589815809), id_17 (1580188368589815810), id_18 (1580188368589815811), id_21 (1580188368589815812), id_22 (1580188368589815813), id_23 (1580188368589815814), ... (125 adds)]} 0 28
[junit4] 2> 121767 INFO (qtp783533656-2695) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&wt=javabin&version=2}{add=[id_1 (1580188368578281472), id_3 (1580188368589815808), id_4 (1580188368589815809), id_5 (1580188368590864384), id_6 (1580188368590864385), id_7 (1580188368590864386), id_8 (1580188368590864387), id_9 (1580188368590864388), id_11 (1580188368590864389), id_12 (1580188368590864390), ... (125 adds)]} 0 27
[junit4] 2> 121781 INFO (qtp1454681523-2705) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368622321664,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121781 INFO (qtp1454681523-2705) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5ca7ee5b commitCommandVersion:1580188368622321664
[junit4] 2> 121781 INFO (qtp783533656-2693) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368622321664,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121781 INFO (qtp783533656-2693) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@50b07988 commitCommandVersion:1580188368622321664
[junit4] 2> 121847 INFO (qtp1454681523-2705) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b83e34b[collection1_shard1_replica_n1] main]
[junit4] 2> 121848 INFO (qtp1454681523-2705) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121849 INFO (searcherExecutor-904-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@3b83e34b[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C125)))}
[junit4] 2> 121849 INFO (qtp1454681523-2705) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 67
[junit4] 2> 121851 INFO (qtp783533656-2693) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ec1969e[collection1_shard2_replica_n2] main]
[junit4] 2> 121852 INFO (qtp783533656-2693) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121852 INFO (searcherExecutor-905-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher Searcher@ec1969e[collection1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C125)))}
[junit4] 2> 121852 INFO (qtp783533656-2693) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 71
[junit4] 2> 121853 INFO (qtp783533656-2697) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&commit=true&wt=javabin&version=2}{commit=} 0 75
[junit4] 2> 121862 INFO (qtp783533656-2700) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/stream params={indent=off&expr=let(a%3Dtimeseries(collection1,+q%3D"*:*",+start%3D"2013-01-01T01:00:00.000Z",+end%3D"2016-12-01T01:00:00.000Z",+gap%3D"%2B1YEAR",+field%3D"test_dt",+count(*),+sum(price_f),+max(price_f),+min(price_f)),+b%3Dselect(timeseries(collection1,+q%3D"*:*",+start%3D"2013-01-01T01:00:00.000Z",+end%3D"2016-12-01T01:00:00.000Z",+gap%3D"%2B1YEAR",+field%3D"test_dt",+count(*),+sum(price_f),+max(price_f),+min(price_f)),mult(-1,+count(*))+as+nvalue),+c%3Dcol(a,+count(*)),+d%3Dcol(b,+nvalue),+tuple(corr%3Dcorr(c,d),+scorr%3DspearmansCorr(array(500,+50,+50,+50),d),+kcorr%3DkendallsCorr(array(500,+50,+50,+50),d),+d%3Dd))&wt=json&version=2.2} status=0 QTime=2
[junit4] 2> 121866 INFO (qtp783533656-2700) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 121867 INFO (qtp783533656-2700) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:56970/solr ready
[junit4] 2> 121894 INFO (qtp783533656-2698) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=collection1:4&_facet_={}&fl=id&fl=score&shards.purpose=1048580&start=0&fsv=true&shard.url=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&rows=0&version=2&q=*:*&json.facet={"timeseries":{"type":"range","field":"test_dt","start":"2013-01-01T01:00:00.000Z","end":"2016-12-01T01:00:00.000Z","gap":"%2B1YEAR","facet":{"facet_0":"sum(price_f)","facet_1":"max(price_f)","facet_2":"min(price_f)"}}}&field=test_dt&NOW=1506985062328&isShard=true&wt=javabin} hits=125 status=0 QTime=11
[junit4] 2> 121894 INFO (qtp1454681523-2710) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=collection1:4&_facet_={}&fl=id&fl=score&shards.purpose=1048580&start=0&fsv=true&shard.url=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&rows=0&version=2&q=*:*&json.facet={"timeseries":{"type":"range","field":"test_dt","start":"2013-01-01T01:00:00.000Z","end":"2016-12-01T01:00:00.000Z","gap":"%2B1YEAR","facet":{"facet_0":"sum(price_f)","facet_1":"max(price_f)","facet_2":"min(price_f)"}}}&field=test_dt&NOW=1506985062328&isShard=true&wt=javabin} hits=125 status=0 QTime=11
[junit4] 2> 121895 INFO (qtp783533656-2699) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=*:*&json.facet={"timeseries":{"type":"range","field":"test_dt","start":"2013-01-01T01:00:00.000Z","end":"2016-12-01T01:00:00.000Z","gap":"%2B1YEAR","facet":{"facet_0":"sum(price_f)","facet_1":"max(price_f)","facet_2":"min(price_f)"}}}&_stateVer_=collection1:4&field=test_dt&rows=0&wt=javabin&version=2} hits=250 status=0 QTime=25
[junit4] 2> 121900 INFO (qtp1454681523-2707) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=collection1:4&_facet_={}&fl=id&fl=score&shards.purpose=1048580&start=0&fsv=true&shard.url=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&rows=0&version=2&q=*:*&json.facet={"timeseries":{"type":"range","field":"test_dt","start":"2013-01-01T01:00:00.000Z","end":"2016-12-01T01:00:00.000Z","gap":"%2B1YEAR","facet":{"facet_0":"sum(price_f)","facet_1":"max(price_f)","facet_2":"min(price_f)"}}}&field=test_dt&NOW=1506985062354&isShard=true&wt=javabin} hits=125 status=0 QTime=2
[junit4] 2> 121900 INFO (qtp783533656-2695) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=collection1:4&_facet_={}&fl=id&fl=score&shards.purpose=1048580&start=0&fsv=true&shard.url=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&rows=0&version=2&q=*:*&json.facet={"timeseries":{"type":"range","field":"test_dt","start":"2013-01-01T01:00:00.000Z","end":"2016-12-01T01:00:00.000Z","gap":"%2B1YEAR","facet":{"facet_0":"sum(price_f)","facet_1":"max(price_f)","facet_2":"min(price_f)"}}}&field=test_dt&NOW=1506985062354&isShard=true&wt=javabin} hits=125 status=0 QTime=2
[junit4] 2> 121901 INFO (qtp783533656-2697) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=*:*&json.facet={"timeseries":{"type":"range","field":"test_dt","start":"2013-01-01T01:00:00.000Z","end":"2016-12-01T01:00:00.000Z","gap":"%2B1YEAR","facet":{"facet_0":"sum(price_f)","facet_1":"max(price_f)","facet_2":"min(price_f)"}}}&_stateVer_=collection1:4&field=test_dt&rows=0&wt=javabin&version=2} hits=250 status=0 QTime=4
[junit4] 2> 121918 INFO (TEST-StreamExpressionTest.testCorrelationStream-seed#[89BF67B7CD937318]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCorrelationStream
[junit4] 2> 121945 INFO (TEST-StreamExpressionTest.testParallelTopicStream-seed#[89BF67B7CD937318]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testParallelTopicStream
[junit4] 2> 121948 INFO (qtp783533656-2696) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@389c221d[collection1_shard2_replica_n2] realtime]
[junit4] 2> 121950 INFO (qtp1454681523-2706) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@286959eb[collection1_shard1_replica_n1] realtime]
[junit4] 2> 121950 INFO (qtp1454681523-2706) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&wt=javabin&version=2}{deleteByQuery=*:* (-1580188368796385280)} 0 3
[junit4] 2> 121953 INFO (qtp1454681523-2708) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368802676736,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121953 INFO (qtp1454681523-2708) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5ca7ee5b commitCommandVersion:1580188368802676736
[junit4] 2> 121953 INFO (qtp783533656-2693) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368802676736,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121953 INFO (qtp783533656-2693) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@50b07988 commitCommandVersion:1580188368802676736
[junit4] 2> 121955 INFO (qtp783533656-2693) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4a17fe9c[collection1_shard2_replica_n2] main]
[junit4] 2> 121956 INFO (qtp783533656-2693) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121957 INFO (searcherExecutor-905-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher Searcher@4a17fe9c[collection1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 121975 INFO (qtp1454681523-2708) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1766623e[collection1_shard1_replica_n1] main]
[junit4] 2> 121976 INFO (qtp1454681523-2708) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121977 INFO (searcherExecutor-904-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@1766623e[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 121977 INFO (qtp783533656-2693) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 24
[junit4] 2> 121978 INFO (qtp1454681523-2708) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 25
[junit4] 2> 121979 INFO (qtp783533656-2696) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1580188368795336704),commit=} 0 33
[junit4] 2> 121983 INFO (qtp1454681523-2705) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=collection1:4&wt=javabin&version=2}{add=[0 (1580188368830988288), 4 (1580188368834134016), 1 (1580188368834134017), 8 (1580188368834134018)]} 0 2
[junit4] 2> 121983 INFO (qtp783533656-2698) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&wt=javabin&version=2}{add=[2 (1580188368830988288), 3 (1580188368834134016), 5 (1580188368834134017), 6 (1580188368834134018), 7 (1580188368834134019), 9 (1580188368834134020)]} 0 2
[junit4] 2> 121985 INFO (qtp783533656-2695) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368836231168,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121985 INFO (qtp1454681523-2701) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368836231168,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 121985 INFO (qtp783533656-2695) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@50b07988 commitCommandVersion:1580188368836231168
[junit4] 2> 121985 INFO (qtp1454681523-2701) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5ca7ee5b commitCommandVersion:1580188368836231168
[junit4] 2> 121997 INFO (qtp1454681523-2701) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@37586954[collection1_shard1_replica_n1] main]
[junit4] 2> 121997 INFO (qtp1454681523-2701) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 121998 INFO (searcherExecutor-904-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@37586954[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.1.0):C4)))}
[junit4] 2> 121998 INFO (qtp1454681523-2701) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 13
[junit4] 2> 121999 INFO (qtp783533656-2695) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@450a11[collection1_shard2_replica_n2] main]
[junit4] 2> 122000 INFO (qtp783533656-2695) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 122000 INFO (searcherExecutor-905-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher Searcher@450a11[collection1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.1.0):C6)))}
[junit4] 2> 122001 INFO (qtp783533656-2695) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 15
[junit4] 2> 122001 INFO (qtp783533656-2699) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&commit=true&wt=javabin&version=2}{commit=} 0 17
[junit4] 2> 122005 INFO (TEST-StreamExpressionTest.testParallelTopicStream-seed#[89BF67B7CD937318]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 122007 INFO (TEST-StreamExpressionTest.testParallelTopicStream-seed#[89BF67B7CD937318]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:56970/solr ready
[junit4] 2> 122011 INFO (qtp1454681523-2707) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/stream params={distrib=false&workerID=1&indent=off&numWorkers=2&expr=topic(collection1,collection1,q%3D"a_s:hello",fl%3Did,partitionKeys%3Did,rows%3D500,zkHost%3D"127.0.0.1:56970/solr",id%3D1000000,checkpointEvery%3D-1)&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 122011 INFO (qtp783533656-2693) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/stream params={distrib=false&workerID=0&indent=off&numWorkers=2&expr=topic(collection1,collection1,q%3D"a_s:hello",fl%3Did,partitionKeys%3Did,rows%3D500,zkHost%3D"127.0.0.1:56970/solr",id%3D1000000,checkpointEvery%3D-1)&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 122030 INFO (qtp783533656-2699) [ ] o.a.s.h.c.RealTimeGetComponent LOOKUP_SLICE:shard2=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/
[junit4] 2> 122030 INFO (qtp783533656-2697) [ ] o.a.s.h.c.RealTimeGetComponent LOOKUP_SLICE:shard2=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/
[junit4] 2> 122032 INFO (qtp783533656-2700) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&omitHeader=true&shards.purpose=1&NOW=1506985062488&ids=1000000_0&isShard=true&shard.url=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&wt=javabin&version=2&shards.qt=/get} status=0 QTime=0
[junit4] 2> 122032 INFO (qtp783533656-2699) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={qt=/get&ids=1000000_0&wt=javabin&version=2} status=0 QTime=16
[junit4] 2> 122033 INFO (qtp783533656-2698) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&omitHeader=true&shards.purpose=1&NOW=1506985062488&ids=1000000_1&isShard=true&shard.url=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&wt=javabin&version=2&shards.qt=/get} status=0 QTime=0
[junit4] 2> 122034 INFO (qtp783533656-2697) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={qt=/get&ids=1000000_1&wt=javabin&version=2} status=0 QTime=18
[junit4] 2> 122034 INFO (qtp783533656-2700) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=*:*&distrib=false&sort=_version_+desc&rows=1&wt=json&version=2.2} hits=6 status=0 QTime=0
[junit4] 2> 122035 INFO (qtp783533656-2699) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=*:*&distrib=false&sort=_version_+desc&rows=1&wt=json&version=2.2} hits=6 status=0 QTime=0
[junit4] 2> 122038 INFO (qtp1454681523-2708) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&distrib=false&sort=_version_+desc&rows=1&wt=json&version=2.2} hits=4 status=0 QTime=0
[junit4] 2> 122039 INFO (qtp1454681523-2706) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&distrib=false&sort=_version_+desc&rows=1&wt=json&version=2.2} hits=4 status=0 QTime=0
[junit4] 2> 122046 INFO (qtp1454681523-2710) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D0}&fq={!frange+cost%3D100+incl%3Dfalse+l%3D1580188368834134018}_version_&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=2
[junit4] 2> 122046 INFO (qtp1454681523-2704) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D1}&fq={!frange+cost%3D100+incl%3Dfalse+l%3D1580188368834134018}_version_&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=2
[junit4] 2> 122046 INFO (qtp783533656-2695) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D0}&fq={!frange+cost%3D100+incl%3Dfalse+l%3D1580188368834134020}_version_&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=2
[junit4] 2> 122047 INFO (qtp783533656-2697) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D1}&fq={!frange+cost%3D100+incl%3Dfalse+l%3D1580188368834134020}_version_&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=2
[junit4] 2> 122051 INFO (qtp783533656-2700) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&collection=collection1&wt=javabin&version=2}{add=[1000000_0 (1580188368903340032)]} 0 2
[junit4] 2> 122052 INFO (qtp783533656-2695) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&collection=collection1&wt=javabin&version=2}{add=[1000000_1 (1580188368906485760)]} 0 0
[junit4] 2> 122055 INFO (qtp1454681523-2710) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368909631488,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 122055 INFO (qtp783533656-2697) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368909631488,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 122055 INFO (qtp1454681523-2710) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 122056 INFO (qtp783533656-2697) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@50b07988 commitCommandVersion:1580188368909631488
[junit4] 2> 122056 INFO (qtp1454681523-2710) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 122056 INFO (qtp1454681523-2710) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 122083 INFO (qtp783533656-2697) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6e223d39[collection1_shard2_replica_n2] main]
[junit4] 2> 122083 INFO (qtp783533656-2697) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 122084 INFO (searcherExecutor-905-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher Searcher@6e223d39[collection1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.1.0):C6) Uninverting(_2(7.1.0):C2)))}
[junit4] 2> 122084 INFO (qtp783533656-2697) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 28
[junit4] 2> 122085 INFO (qtp783533656-2700) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 30
[junit4] 2> 122094 INFO (qtp1454681523-2701) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=id:1000000*&distrib=false&fl=id,+checkpoint_ss,+_version_&sort=id+asc&wt=json&version=2.2} hits=0 status=0 QTime=5
[junit4] 2> 122095 INFO (qtp783533656-2696) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=id:1000000*&distrib=false&fl=id,+checkpoint_ss,+_version_&sort=id+asc&wt=json&version=2.2} hits=2 status=0 QTime=6
[junit4] 2> 122107 INFO (qtp1454681523-2707) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=collection1:4&wt=javabin&version=2}{add=[10 (1580188368953671680), 11 (1580188368964157440)]} 0 10
[junit4] 2> 122111 INFO (qtp783533656-2699) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368968351744,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 122111 INFO (qtp1454681523-2706) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188368968351744,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 122111 INFO (qtp783533656-2699) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 122111 INFO (qtp1454681523-2706) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5ca7ee5b commitCommandVersion:1580188368968351744
[junit4] 2> 122112 INFO (qtp783533656-2699) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 122112 INFO (qtp783533656-2699) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 122117 INFO (qtp1454681523-2706) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c723f6b[collection1_shard1_replica_n1] main]
[junit4] 2> 122117 INFO (qtp1454681523-2706) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 122118 INFO (searcherExecutor-904-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@1c723f6b[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(7.1.0):C4) Uninverting(_2(7.1.0):C2)))}
[junit4] 2> 122118 INFO (qtp1454681523-2706) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:56976/solr/collection1_shard1_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 7
[junit4] 2> 122119 INFO (qtp1454681523-2710) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=collection1:4&commit=true&wt=javabin&version=2}{commit=} 0 10
[junit4] 2> 122122 INFO (qtp1454681523-2708) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/stream params={distrib=false&workerID=1&indent=off&numWorkers=2&expr=topic(collection1,collection1,q%3D"a_s:hello",fl%3Did,partitionKeys%3Did,rows%3D500,zkHost%3D"127.0.0.1:56970/solr",id%3D1000000,checkpointEvery%3D-1)&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 122122 INFO (qtp783533656-2695) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/stream params={distrib=false&workerID=0&indent=off&numWorkers=2&expr=topic(collection1,collection1,q%3D"a_s:hello",fl%3Did,partitionKeys%3Did,rows%3D500,zkHost%3D"127.0.0.1:56970/solr",id%3D1000000,checkpointEvery%3D-1)&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 122125 INFO (qtp783533656-2700) [ ] o.a.s.h.c.RealTimeGetComponent LOOKUP_SLICE:shard2=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/
[junit4] 2> 122126 INFO (qtp783533656-2698) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&omitHeader=true&shards.purpose=1&NOW=1506985062583&ids=1000000_0&isShard=true&shard.url=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&wt=javabin&version=2&shards.qt=/get} status=0 QTime=0
[junit4] 2> 122126 INFO (qtp783533656-2697) [ ] o.a.s.h.c.RealTimeGetComponent LOOKUP_SLICE:shard2=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/
[junit4] 2> 122127 INFO (qtp783533656-2700) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={qt=/get&ids=1000000_0&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 122128 INFO (qtp783533656-2693) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&omitHeader=true&shards.purpose=1&NOW=1506985062584&ids=1000000_1&isShard=true&shard.url=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&wt=javabin&version=2&shards.qt=/get} status=0 QTime=0
[junit4] 2> 122128 INFO (qtp783533656-2697) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={qt=/get&ids=1000000_1&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 122131 INFO (qtp783533656-2696) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D0}&fq={!frange+cost%3D100+incl%3Dfalse+l%3D1580188368834134020}_version_&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 122133 INFO (qtp1454681523-2706) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D0}&fq={!frange+cost%3D100+incl%3Dfalse+l%3D1580188368834134018}_version_&rows=500&wt=json&version=2.2} hits=1 status=0 QTime=0
[junit4] 2> 122136 INFO (qtp783533656-2699) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&collection=collection1&wt=javabin&version=2}{add=[1000000_0 (1580188368992468992)]} 0 1
[junit4] 2> 122136 INFO (qtp1454681523-2705) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D1}&fq={!frange+cost%3D100+incl%3Dfalse+l%3D1580188368834134018}_version_&rows=500&wt=json&version=2.2} hits=1 status=0 QTime=1
[junit4] 2> 122138 INFO (qtp783533656-2698) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D1}&fq={!frange+cost%3D100+incl%3Dfalse+l%3D1580188368834134020}_version_&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 122140 INFO (qtp783533656-2696) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&collection=collection1&wt=javabin&version=2}{add=[1000000_1 (1580188368997711872)]} 0 0
[junit4] 2> 122145 INFO (qtp783533656-2696) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/stream params={distrib=false&workerID=0&indent=off&numWorkers=2&expr=topic(collection1,collection1,q%3D"a_s:hello",fl%3Did,initialCheckpoint%3D0,partitionKeys%3Did,rows%3D500,zkHost%3D"127.0.0.1:56970/solr",id%3D2000000,initialCheckpoint%3D0,checkpointEvery%3D-1)&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 122145 INFO (qtp1454681523-2706) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/stream params={distrib=false&workerID=1&indent=off&numWorkers=2&expr=topic(collection1,collection1,q%3D"a_s:hello",fl%3Did,initialCheckpoint%3D0,partitionKeys%3Did,rows%3D500,zkHost%3D"127.0.0.1:56970/solr",id%3D2000000,initialCheckpoint%3D0,checkpointEvery%3D-1)&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 122148 INFO (qtp783533656-2699) [ ] o.a.s.h.c.RealTimeGetComponent LOOKUP_SLICE:shard2=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/
[junit4] 2> 122148 INFO (qtp783533656-2693) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&omitHeader=true&shards.purpose=1&NOW=1506985062606&ids=2000000_1&isShard=true&shard.url=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&wt=javabin&version=2&shards.qt=/get} status=0 QTime=0
[junit4] 2> 122149 INFO (qtp783533656-2699) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={qt=/get&ids=2000000_1&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 122149 INFO (qtp783533656-2697) [ ] o.a.s.h.c.RealTimeGetComponent LOOKUP_SLICE:shard2=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/
[junit4] 2> 122150 INFO (qtp783533656-2695) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&omitHeader=true&shards.purpose=1&NOW=1506985062607&ids=2000000_0&isShard=true&shard.url=https://127.0.0.1:56972/solr/collection1_shard2_replica_n2/&wt=javabin&version=2&shards.qt=/get} status=0 QTime=0
[junit4] 2> 122151 INFO (qtp783533656-2697) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={qt=/get&ids=2000000_0&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 122152 INFO (qtp783533656-2700) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&initialCheckpoint=0&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D1}&rows=500&wt=json&version=2.2} hits=4 status=0 QTime=0
[junit4] 2> 122155 INFO (qtp1454681523-2708) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&initialCheckpoint=0&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D1}&rows=500&wt=json&version=2.2} hits=2 status=0 QTime=0
[junit4] 2> 122155 INFO (qtp783533656-2698) [ ] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&initialCheckpoint=0&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D0}&rows=500&wt=json&version=2.2} hits=2 status=0 QTime=0
[junit4] 2> 122157 INFO (qtp783533656-2693) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&collection=collection1&wt=javabin&version=2}{add=[2000000_1 (1580188369016586240)]} 0 0
[junit4] 2> 122157 INFO (qtp1454681523-2704) [ ] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={q=a_s:hello&distrib=false&fl=id,_version_&initialCheckpoint=0&partitionKeys=id&sort=_version_+asc&fq={!hash+workers%3D2+worker%3D0}&rows=500&wt=json&version=2.2} hits=4 status=0 QTime=0
[junit4] 2> 122159 INFO (qtp783533656-2695) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={_stateVer_=collection1:4&collection=collection1&wt=javabin&version=2}{add=[2000000_0 (1580188369018683392)]} 0 0
[junit4] 2> 122162 INFO (qtp1454681523-2708) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=collection1:4&wt=javabin&version=2}{add=[12 (1580188369020780544), 13 (1580188369021829120)]} 0 1
[junit4] 2> 122165 INFO (qtp1454681523-2706) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188369024974848,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 122165 INFO (qtp783533656-2698) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580188369024974848,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 122165 INFO (qtp1454681523-2706) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5ca7ee5b commitCommandVersion:1580188369024974848
[junit4] 2> 122165 INFO (qtp783533656-2698) [ ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@50b07988 commitCommandVersion:1580188369024974848
[junit4] 2> 122313 INFO (qtp783533656-2698) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5abb4fea[collection1_shard2_replica_n2] main]
[junit4] 2> 122313 INFO (qt
[...truncated too long message...]
.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@43e8920a: rootName = solr_56976, domain = solr.core.mainCorpus.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.mainCorpus.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@281bd44f
[junit4] 2> 232954 INFO (coreCloseExecutor-1094-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.destination.shard1.leader, tag=283727047
[junit4] 2> 232963 INFO (coreCloseExecutor-1097-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.mainCorpus.shard2.leader, tag=1927956941
[junit4] 2> 232965 INFO (coreCloseExecutor-1095-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.mainCorpus.shard1.leader, tag=344706611
[junit4] 2> 232969 INFO (zkCallback-911-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 232969 INFO (zkCallback-907-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 232980 INFO (zkCallback-911-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 232990 INFO (jetty-closer-890-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98761772786581516-127.0.0.1:56975_solr-n_0000000000) closing
[junit4] 2> 232991 INFO (OverseerStateUpdate-98761772786581516-127.0.0.1:56975_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:56975_solr
[junit4] 2> 234435 WARN (zkCallback-909-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 234435 INFO (jetty-closer-890-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@225ab1bf{/solr,null,UNAVAILABLE}
[junit4] 2> 234479 WARN (zkCallback-910-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 234479 INFO (jetty-closer-890-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@24cb4288{/solr,null,UNAVAILABLE}
[junit4] 2> 234490 WARN (zkCallback-907-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 234491 INFO (jetty-closer-890-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5e7ee8e1{/solr,null,UNAVAILABLE}
[junit4] 2> 234503 WARN (zkCallback-911-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 234503 INFO (jetty-closer-890-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1d0ef707{/solr,null,UNAVAILABLE}
[junit4] 2> 234507 ERROR (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 234507 INFO (SUITE-StreamExpressionTest-seed#[89BF67B7CD937318]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56970 56970
[junit4] 2> 234545 INFO (Thread-397) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56970 56970
[junit4] 2> 234688 WARN (Thread-397) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 98 /solr/aliases.json
[junit4] 2> 17 /solr/configs/conf
[junit4] 2> 7 /solr/configs/ml
[junit4] 2> 4 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 98 /solr/clusterprops.json
[junit4] 2> 98 /solr/clusterstate.json
[junit4] 2> 38 /solr/collections/destinationCollection/state.json
[junit4] 2> 26 /solr/collections/parallelDestinationCollection1/state.json
[junit4] 2> 24 /solr/collections/destination/state.json
[junit4] 2> 22 /solr/collections/mainCorpus/state.json
[junit4] 2> 20 /solr/collections/parallelDestinationCollection/state.json
[junit4] 2> 20 /solr/collections/workQueue/state.json
[junit4] 2> 12 /solr/collections/collection1/state.json
[junit4] 2> 10 /solr/collections/uknownCollection/state.json
[junit4] 2> 10 /solr/collections/modelCollection/state.json
[junit4] 2> 10 /solr/collections/checkpointCollection/state.json
[junit4] 2> 2 /solr/overseer_elect/election/98761772786581516-127.0.0.1:56975_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 98 /solr/live_nodes
[junit4] 2> 98 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_89BF67B7CD937318-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {name_s=PostingsFormat(name=Asserting), expr_s=BlockTreeOrds(blocksize=128), terms_ss=PostingsFormat(name=Direct), join2_s=PostingsFormat(name=Direct), field_s=PostingsFormat(name=Memory), multiDefault=PostingsFormat(name=Direct), subject=PostingsFormat(name=Direct), a1_s=PostingsFormat(name=Direct), a2_s=PostingsFormat(name=Asserting), level1_s=BlockTreeOrds(blocksize=128), body_t=PostingsFormat(name=Asserting), s_multi=PostingsFormat(name=Asserting), level2_s=PostingsFormat(name=Memory), col_s=PostingsFormat(name=Direct), a_ss=PostingsFormat(name=Memory), a_s=PostingsFormat(name=Asserting), tv_text=PostingsFormat(name=Memory), term_s=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Memory), text_s=BlockTreeOrds(blocksize=128), id=BlockTreeOrds(blocksize=128), text=PostingsFormat(name=Asserting), featureSet_s=PostingsFormat(name=Direct), checkpoint_ss=PostingsFormat(name=Asserting), test_t=PostingsFormat(name=Asserting), ident_s=PostingsFormat(name=Direct), whitetok=PostingsFormat(name=Asserting), side_s=PostingsFormat(name=Asserting)}, docValues:{name_s=DocValuesFormat(name=Asserting), expr_s=DocValuesFormat(name=Direct), iteration_i=DocValuesFormat(name=Direct), terms_ss=DocValuesFormat(name=Lucene70), join2_s=DocValuesFormat(name=Lucene70), multiDefault=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Lucene70), a_f=DocValuesFormat(name=Lucene70), falseNegative_i=DocValuesFormat(name=Lucene70), a2_s=DocValuesFormat(name=Asserting), a_i=DocValuesFormat(name=Direct), level1_s=DocValuesFormat(name=Direct), a_s=DocValuesFormat(name=Asserting), id=DocValuesFormat(name=Direct), alpha_d=DocValuesFormat(name=Asserting), i_multi=DocValuesFormat(name=Direct), idf_d=DocValuesFormat(name=Lucene70), b_ls=DocValuesFormat(name=Lucene70), checkpoint_ss=DocValuesFormat(name=Asserting), ident_s=DocValuesFormat(name=Lucene70), order_i=DocValuesFormat(name=Lucene70), error_d=DocValuesFormat(name=Direct), side_s=DocValuesFormat(name=Asserting), truePositive_i=DocValuesFormat(name=Direct), miles_i=DocValuesFormat(name=Lucene70), field_s=DocValuesFormat(name=Lucene70), price_f=DocValuesFormat(name=Lucene70), a1_s=DocValuesFormat(name=Lucene70), join1_i=DocValuesFormat(name=Direct), join3_i=DocValuesFormat(name=Asserting), test_i=DocValuesFormat(name=Lucene70), falsePositive_i=DocValuesFormat(name=Lucene70), field_i=DocValuesFormat(name=Lucene70), s_multi=DocValuesFormat(name=Asserting), level2_s=DocValuesFormat(name=Lucene70), col_s=DocValuesFormat(name=Lucene70), a_ss=DocValuesFormat(name=Lucene70), score_f=DocValuesFormat(name=Asserting), term_s=DocValuesFormat(name=Lucene70), text_s=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Lucene70), idfs_ds=DocValuesFormat(name=Lucene70), featureSet_s=DocValuesFormat(name=Lucene70), weights_ds=DocValuesFormat(name=Asserting), trueNegative_i=DocValuesFormat(name=Asserting), index_i=DocValuesFormat(name=Lucene70), test_dt=DocValuesFormat(name=Direct), out_i=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=247, maxMBSortInHeap=7.330809014922133, sim=RandomSimilarity(queryNorm=true): {}, locale=kea, timezone=Asia/Almaty
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 9 (64-bit)/cpus=3,threads=1,free=129619008,total=470810624
[junit4] 2> NOTE: All tests run in this JVM: [HttpSolrClientBuilderTest, StreamExpressionToExpessionTest, ReverseEvaluatorTest, CeilingEvaluatorTest, SolrQueryTest, TestNamedListCodec, CloudSolrClientBuilderTest, TestV1toV2ApiMapper, CommonAdminParamsTest, DocumentAnalysisResponseTest, ExclusiveOrEvaluatorTest, LessThanEvaluatorTest, HyperbolicSineEvaluatorTest, MergeIndexesEmbeddedTest, LargeVolumeJettyTest, SineEvaluatorTest, MultiplyEvaluatorTest, TestCloudSolrClientConnections, CumulativeProbabilityEvaluatorTest, TestCollectionStateWatchers, LargeVolumeBinaryJettyTest, SubtractEvaluatorTest, TestPolicy, LengthEvaluatorTest, ClientUtilsTest, NotEvaluatorTest, FacetFieldTest, SolrExampleBinaryTest, PowerEvaluatorTest, SolrExampleStreamingBinaryTest, LargeVolumeEmbeddedTest, SelectWithEvaluatorsTest, AppendEvaluatorTest, HttpSolrClientSSLAuthConPoolTest, ConcatOperationTest, SolrExampleJettyTest, TestBatchUpdate, TestSolrProperties, SolrParamTest, QueryResponseTest, TestCoreAdmin, TestJavaBinCodec, TestHash, TestFastInputStream, SolrDocumentTest, AnlysisResponseBaseTest, CollectionAdminRequestRequiredParamsTest, TestLBHttpSolrClient, LBHttpSolrClientBuilderTest, GraphExpressionTest, JdbcDriverTest, JdbcTest, StreamExpressionTest]
[junit4] Completed [145/145 (1!)] on J1 in 116.78s, 117 tests, 1 error <<< FAILURES!
[...truncated 38833 lines...]
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 222 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/222/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.lucene.TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([D853AFC32C37680:8A04875136E30C84]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.lucene.TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler(TestMergeSchedulerExternal.java:147)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Error from server at http://127.0.0.1:53192/solr/awhollynewcollection_0_shard2_replica_n2: ClusterState says we are the leader (http://127.0.0.1:53192/solr/awhollynewcollection_0_shard2_replica_n2), but locally we don't think so. Request came from null
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:53192/solr/awhollynewcollection_0_shard2_replica_n2: ClusterState says we are the leader (http://127.0.0.1:53192/solr/awhollynewcollection_0_shard2_replica_n2), but locally we don't think so. Request came from null
at __randomizedtesting.SeedInfo.seed([AC327EC2E4BDF7B2:E4470A76E28ED827]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:459)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:53192/solr/awhollynewcollection_0_shard2_replica_n2: ClusterState says we are the leader (http://127.0.0.1:53192/solr/awhollynewcollection_0_shard2_replica_n2), but locally we don't think so. Request came from null
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Build Log:
[...truncated 249 lines...]
[junit4] Suite: org.apache.lucene.TestMergeSchedulerExternal
[junit4] 1> TEST FAILED; IW infoStream output:
[junit4] 1> IFD 0 [2017-10-02T11:05:00.424Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: init: current segments file is "segments"; deletionPolicy=org.apache.lucene.index.KeepOnlyLastCommitDeletionPolicy@6a5ba0f4
[junit4] 1> IFD 0 [2017-10-02T11:05:00.437Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "" [0 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:00.437Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> IW 0 [2017-10-02T11:05:00.437Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: init: create=true
[junit4] 1> IW 0 [2017-10-02T11:05:00.437Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]:
[junit4] 1> dir=MockDirectoryWrapper(RAMDirectory@659905c5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@749590d1)
[junit4] 1> index=
[junit4] 1> version=7.1.0
[junit4] 1> analyzer=org.apache.lucene.analysis.MockAnalyzer
[junit4] 1> ramBufferSizeMB=-1.0
[junit4] 1> maxBufferedDocs=2
[junit4] 1> mergedSegmentWarmer=null
[junit4] 1> delPolicy=org.apache.lucene.index.KeepOnlyLastCommitDeletionPolicy
[junit4] 1> commit=null
[junit4] 1> openMode=CREATE_OR_APPEND
[junit4] 1> similarity=org.apache.lucene.search.similarities.RandomSimilarity
[junit4] 1> mergeScheduler=MyMergeScheduler: maxThreadCount=-1, maxMergeCount=-1, ioThrottle=true
[junit4] 1> codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> infoStream=org.apache.lucene.util.PrintStreamInfoStream
[junit4] 1> mergePolicy=[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=42, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 1> indexerThreadPool=org.apache.lucene.index.DocumentsWriterPerThreadPool@40128d59
[junit4] 1> readerPooling=true
[junit4] 1> perThreadHardLimitMB=1945
[junit4] 1> useCompoundFile=false
[junit4] 1> commitOnClose=true
[junit4] 1> indexSort=null
[junit4] 1> writer=org.apache.lucene.index.IndexWriter@13b29a56
[junit4] 1>
[junit4] 1> IW 0 [2017-10-02T11:05:00.437Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: MMapDirectory.UNMAP_SUPPORTED=true
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.441Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _0 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:00.441Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:00.441Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:00.441Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:00.447Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 5 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:00.465Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 18 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:00.490Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 24 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.490Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.490Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.490Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_0_LuceneVarGapDocFreqInterval_0.tiv, _0_LuceneVarGapDocFreqInterval_0.tib, _0.fdx, _0.fdt, _0_LuceneVarGapDocFreqInterval_0.doc, _0.fnm]
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.490Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.531Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_0 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.575Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 134.286437 msec
[junit4] 1> DW 0 [2017-10-02T11:05:00.576Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:00.576Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _0(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:00.576Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=1 now completedDelGen=1
[junit4] 1> IW 0 [2017-10-02T11:05:00.576Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=1 seg=_0(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:00.576Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2" [1 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:00.576Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:00.576Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 1 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:00.642Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:00.642Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 1 segments
[junit4] 1> MS 0 [2017-10-02T11:05:00.643Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: initDynamicDefaults spins=false maxThreadCount=1 maxMergeCount=6
[junit4] 1> MS 0 [2017-10-02T11:05:00.643Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:00.643Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:00.643Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.649Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _1 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:00.649Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:00.649Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:00.649Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:00.654Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:00.681Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 27 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:00.705Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 23 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.705Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.705Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.705Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_1_LuceneVarGapDocFreqInterval_0.tib, _1_LuceneVarGapDocFreqInterval_0.doc, _1.fdx, _1_LuceneVarGapDocFreqInterval_0.tiv, _1.fnm, _1.fdt]
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.705Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.726Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_1 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 83.845435 msec
[junit4] 1> DW 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _1(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=2 now completedDelGen=2
[junit4] 1> IW 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=2 seg=_1(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2" [2 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 2 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:00.733Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:00.779Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:00.779Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 2 segments
[junit4] 1> MS 0 [2017-10-02T11:05:00.779Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:00.779Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:00.779Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.793Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _2 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:00.793Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:00.793Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:00.793Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:00.797Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:00.848Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 50 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:00.852Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.852Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.852Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.852Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_2_LuceneVarGapDocFreqInterval_0.tiv, _2_LuceneVarGapDocFreqInterval_0.tib, _2.fdt, _2.fnm, _2.fdx, _2_LuceneVarGapDocFreqInterval_0.doc]
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.852Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.877Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_2 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 132.096039 msec
[junit4] 1> DW 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _2(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=3 now completedDelGen=3
[junit4] 1> IW 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=3 seg=_2(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2" [3 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 3 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:00.925Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:00.947Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_2(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:00.947Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 3 segments
[junit4] 1> MS 0 [2017-10-02T11:05:00.947Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:00.947Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:00.947Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.953Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _3 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:00.953Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:00.953Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:00.953Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:00.957Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:00.981Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 23 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:00.991Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 10 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.991Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.991Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.991Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_3.fdx, _3_LuceneVarGapDocFreqInterval_0.tib, _3_LuceneVarGapDocFreqInterval_0.tiv, _3.fnm, _3_LuceneVarGapDocFreqInterval_0.doc, _3.fdt]
[junit4] 1> DWPT 0 [2017-10-02T11:05:00.991Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.004Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_3 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.009Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 56.830786 msec
[junit4] 1> DW 0 [2017-10-02T11:05:01.009Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _3(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=4 now completedDelGen=4
[junit4] 1> IW 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=4 seg=_3(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2" [4 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 4 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.010Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_2(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.013Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_3(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.013Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 4 segments
[junit4] 1> MS 0 [2017-10-02T11:05:01.013Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:01.013Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.013Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.026Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _4 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:01.026Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:01.026Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:01.026Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:01.041Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 14 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:01.073Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 31 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:01.081Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 7 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.081Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.081Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.081Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_4.fdt, _4.fnm, _4_LuceneVarGapDocFreqInterval_0.doc, _4_LuceneVarGapDocFreqInterval_0.tib, _4.fdx, _4_LuceneVarGapDocFreqInterval_0.tiv]
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.081Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.081Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_4 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 61.461512 msec
[junit4] 1> DW 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _4(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=5 now completedDelGen=5
[junit4] 1> IW 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=5 seg=_4(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2" [5 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 5 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_2(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.088Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_3(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.089Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_4(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.089Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 5 segments
[junit4] 1> MS 0 [2017-10-02T11:05:01.089Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:01.089Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.089Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.091Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _5 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:01.091Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:01.091Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:01.091Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:01.094Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 2 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:01.122Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 27 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:01.127Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.127Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.127Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.127Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_5.fnm, _5_LuceneVarGapDocFreqInterval_0.tib, _5.fdt, _5_LuceneVarGapDocFreqInterval_0.tiv, _5_LuceneVarGapDocFreqInterval_0.doc, _5.fdx]
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.127Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.130Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_5 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 46.314564 msec
[junit4] 1> DW 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _5(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=6 now completedDelGen=6
[junit4] 1> IW 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=6 seg=_5(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2" [6 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 6 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_2(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_3(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.138Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_4(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.140Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_5(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.140Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 6 segments
[junit4] 1> MS 0 [2017-10-02T11:05:01.140Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:01.140Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.140Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.143Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _6 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:01.143Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:01.143Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:01.143Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:01.149Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 6 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:01.169Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 20 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:01.174Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 5 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.175Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.175Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.175Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_6_LuceneVarGapDocFreqInterval_0.tiv, _6.fdt, _6_LuceneVarGapDocFreqInterval_0.doc, _6.fnm, _6.fdx, _6_LuceneVarGapDocFreqInterval_0.tib]
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.175Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.189Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_6 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.198Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 55.443249 msec
[junit4] 1> DW 0 [2017-10-02T11:05:01.198Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:01.198Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _6(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:01.198Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=7 now completedDelGen=7
[junit4] 1> IW 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=7 seg=_6(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2" [7 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 7 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_2(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_3(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_4(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.199Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_5(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.205Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_6(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.205Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 7 segments
[junit4] 1> MS 0 [2017-10-02T11:05:01.205Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:01.205Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.205Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.209Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _7 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:01.209Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:01.209Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:01.209Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:01.213Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:01.232Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 18 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:01.236Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.236Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.236Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.236Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_7_LuceneVarGapDocFreqInterval_0.doc, _7_LuceneVarGapDocFreqInterval_0.tib, _7.fnm, _7.fdt, _7_LuceneVarGapDocFreqInterval_0.tiv, _7.fdx]
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.236Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.236Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_7 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.245Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 36.610553 msec
[junit4] 1> DW 0 [2017-10-02T11:05:01.245Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:01.245Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _7(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:01.245Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=8 now completedDelGen=8
[junit4] 1> IW 0 [2017-10-02T11:05:01.245Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=8 seg=_7(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2" [8 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 8 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_2(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_3(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_4(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_5(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.246Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_6(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.252Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_7(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.252Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 8 segments
[junit4] 1> MS 0 [2017-10-02T11:05:01.252Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:01.252Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.252Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.257Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _8 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:01.257Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:01.257Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:01.257Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:01.261Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:01.275Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 13 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:01.280Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.280Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.280Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.280Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_8.fdx, _8.fdt, _8_LuceneVarGapDocFreqInterval_0.tiv, _8.fnm, _8_LuceneVarGapDocFreqInterval_0.tib, _8_LuceneVarGapDocFreqInterval_0.doc]
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.280Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.280Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_8 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 28.973195 msec
[junit4] 1> DW 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _8(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=9 now completedDelGen=9
[junit4] 1> IW 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=9 seg=_8(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2" [9 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 9 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_2(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_3(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_4(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_5(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_6(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.286Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_7(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.287Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_8(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.287Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 9 segments
[junit4] 1> MS 0 [2017-10-02T11:05:01.287Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:01.288Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.288Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.291Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush postings as segment _9 numDocs=2
[junit4] 1> IW 0 [2017-10-02T11:05:01.291Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write norms
[junit4] 1> IW 0 [2017-10-02T11:05:01.291Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write docValues
[junit4] 1> IW 0 [2017-10-02T11:05:01.291Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to write points
[junit4] 1> IW 0 [2017-10-02T11:05:01.295Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 4 msec to finish stored fields
[junit4] 1> IW 0 [2017-10-02T11:05:01.316Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 20 msec to write postings and finish vectors
[junit4] 1> IW 0 [2017-10-02T11:05:01.321Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 5 msec to write fieldInfos
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.321Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has 0 deleted docs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.321Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: new segment has no vectors; no norms; no docValues; no prox; no freqs
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.321Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushedFiles=[_9.fdx, _9_LuceneVarGapDocFreqInterval_0.tib, _9.fdt, _9_LuceneVarGapDocFreqInterval_0.doc, _9.fnm, _9_LuceneVarGapDocFreqInterval_0.tiv]
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.321Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.324Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flushed: segment=_9 ramUsed=0.071 MB newFlushedSize=0.001 MB docs/MB=2,661.36
[junit4] 1> DWPT 0 [2017-10-02T11:05:01.339Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: flush time 48.731388 msec
[junit4] 1> DW 0 [2017-10-02T11:05:01.339Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment seg-private updates=null
[junit4] 1> IW 0 [2017-10-02T11:05:01.339Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publishFlushedSegment _9(7.1.0):C2
[junit4] 1> BD 0 [2017-10-02T11:05:01.339Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: finished packet delGen=10 now completedDelGen=10
[junit4] 1> IW 0 [2017-10-02T11:05:01.339Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: publish sets newSegment delGen=10 seg=_9(7.1.0):C2
[junit4] 1> IFD 0 [2017-10-02T11:05:01.339Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now checkpoint "_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2" [10 segments ; isCommit = false]
[junit4] 1> IFD 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: 0 msec to checkpoint
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: findMerges: 10 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_0(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_1(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_2(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_3(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_4(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_5(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_6(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_7(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.340Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_8(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.343Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: seg=_9(7.1.0):C2 level=3.1085649 size=0.001 MB
[junit4] 1> LMP 0 [2017-10-02T11:05:01.343Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: level -1.0 to 3.1085649: 10 segments
[junit4] 1> LMP 0 [2017-10-02T11:05:01.344Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: add merge=_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2 start=0 end=10
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: add merge to pendingMerges: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2 [total 1 pending]
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge merging= []
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_0(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_1(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_2(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_3(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_4(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_5(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_6(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_7(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_8(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: registerMerge info=_9(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: now merge
[junit4] 1> MS 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: index: _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.346Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: consider merge _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2
[junit4] 1> MS 0 [2017-10-02T11:05:01.348Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: launch new thread [MyMergeThread]
[junit4] 1> MS 0 [2017-10-02T11:05:01.348Z; MyMergeThread]: merge thread: start
[junit4] 1> BD 0 [2017-10-02T11:05:01.349Z; MyMergeThread]: waitApplyForMerge: 0 packets, 10 merging segments
[junit4] 1> BD 0 [2017-10-02T11:05:01.349Z; MyMergeThread]: waitApply: no deletes to apply
[junit4] 1> IW 0 [2017-10-02T11:05:01.349Z; MyMergeThread]: now apply deletes for 10 merging segments
[junit4] 1> IW 0 [2017-10-02T11:05:01.350Z; MyMergeThread]: merge seg=_a _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.350Z; MyMergeThread]: now merge
[junit4] 1> merge=_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2
[junit4] 1> index=_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.351Z; MyMergeThread]: merging _0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2
[junit4] 1> IW 0 [2017-10-02T11:05:01.351Z; MyMergeThread]: TEST: now throw exc:
[junit4] 1> java.io.IOException: now failing during merge
[junit4] 1> at org.apache.lucene.TestMergeSchedulerExternal$FailOnlyOnMerge.eval(TestMergeSchedulerExternal.java:95)
[junit4] 1> at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowDeterministicException(MockDirectoryWrapper.java:1022)
[junit4] 1> at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:743)
[junit4] 1> at org.apache.lucene.store.Directory.openChecksumInput(Directory.java:119)
[junit4] 1> at org.apache.lucene.store.MockDirectoryWrapper.openChecksumInput(MockDirectoryWrapper.java:1072)
[junit4] 1> at org.apache.lucene.codecs.lucene60.Lucene60FieldInfosFormat.read(Lucene60FieldInfosFormat.java:113)
[junit4] 1> at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:107)
[junit4] 1> at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:78)
[junit4] 1> at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:208)
[junit4] 1> at org.apache.lucene.index.ReadersAndUpdates.getReaderForMerge(ReadersAndUpdates.java:836)
[junit4] 1> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4362)
[junit4] 1> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4032)
[junit4] 1> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:624)
[junit4] 1> at org.apache.lucene.TestMergeSchedulerExternal$MyMergeScheduler.doMerge(TestMergeSchedulerExternal.java:85)
[junit4] 1> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:661)
[junit4] 1>
[junit4] 1> IW 0 [2017-10-02T11:05:01.352Z; MyMergeThread]: handleMergeException: merge=_0(7.1.0):C2 _1(7.1.0):C2 _2(7.1.0):C2 _3(7.1.0):C2 _4(7.1.0):C2 _5(7.1.0):C2 _6(7.1.0):C2 _7(7.1.0):C2 _8(7.1.0):C2 _9(7.1.0):C2 exc=java.io.IOException: now failing during merge
[junit4] 1> IW 0 [2017-10-02T11:05:01.352Z; MyMergeThread]: hit exception during merge
[junit4] 1> IW 0 [2017-10-02T11:05:01.352Z; MyMergeThread]: hit tragic IOException inside merge
[junit4] 1> IW 0 [2017-10-02T11:05:01.352Z; MyMergeThread]: rollback
[junit4] 1> IW 0 [2017-10-02T11:05:01.352Z; MyMergeThread]: all running merges have aborted
[junit4] 1> IW 0 [2017-10-02T11:05:01.352Z; MyMergeThread]: rollback: done finish merges
[junit4] 1> MS 0 [2017-10-02T11:05:01.355Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: updateMergeThreads ioThrottle=true targetMBPerSec=20.0 MB/sec
[junit4] 1> merge thread MyMergeThread estSize=0.0 MB (written=0.0 MB) runTime=0.0s (stopped=0.0s, paused=0.0s) rate=unlimited
[junit4] 1> leave running at Infinity MB/sec
[junit4] 1> MS 0 [2017-10-02T11:05:01.355Z; TEST-TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler-seed#[D853AFC32C37680]]: no more merges pending; now return
[junit4] 1> DW 0 [2017-10-02T11:05:01.355Z; MyMergeThread]: abort
[junit4] 1> DW 0 [2017-10-02T11:05:01.355Z; MyMergeThread]: done abort success=true
[junit4] 1> IW 0 [2017-10-02T11:05:01.355Z; MyMergeThread]: rollback: infos=
[junit4] 1> IW 0 [2017-10-02T11:05:01.356Z; MyMergeThread]: TEST: now handleMergeException
[junit4] 1> MS 0 [2017-10-02T11:05:01.356Z; MyMergeThread]: updateMergeThreads ioThrottle=true targetMBPerSec=20.0 MB/sec
[junit4] 1>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestMergeSchedulerExternal -Dtests.method=testSubclassConcurrentMergeScheduler -Dtests.seed=D853AFC32C37680 -Dtests.slow=true -Dtests.locale=zh-HK -Dtests.timezone=America/Buenos_Aires -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 1.01s J1 | TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([D853AFC32C37680:8A04875136E30C84]:0)
[junit4] > at org.apache.lucene.TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler(TestMergeSchedulerExternal.java:147)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, maxPointsInLeafNode=1073, maxMBSortInHeap=7.924571263640305, sim=RandomSimilarity(queryNorm=false): {}, locale=zh-HK, timezone=America/Buenos_Aires
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=42243016,total=54788096
[junit4] 2> NOTE: All tests run in this JVM: [TestSpanMultiTermQueryWrapper, TestSimilarityBase, TestMergeSchedulerExternal]
[junit4] Completed [9/454 (1!)] on J1 in 1.09s, 2 tests, 1 failure <<< FAILURES!
[...truncated 11806 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AC327EC2E4BDF7B2-001/init-core-data-001
[junit4] 2> 481465 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[AC327EC2E4BDF7B2]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 481466 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[AC327EC2E4BDF7B2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 481466 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[AC327EC2E4BDF7B2]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 481468 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[AC327EC2E4BDF7B2]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AC327EC2E4BDF7B2-001/tempDir-001
[junit4] 2> 481468 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[AC327EC2E4BDF7B2]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 481469 INFO (Thread-1432) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 481469 INFO (Thread-1432) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 481475 ERROR (Thread-1432) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 481579 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[AC327EC2E4BDF7B2]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:53187
[junit4] 2> 481614 INFO (jetty-launcher-908-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 481615 INFO (jetty-launcher-908-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 481619 INFO (jetty-launcher-908-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@225d159a{/solr,null,AVAILABLE}
[junit4] 2> 481621 INFO (jetty-launcher-908-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6faa5c79{/solr,null,AVAILABLE}
[junit4] 2> 481623 INFO (jetty-launcher-908-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@69231d33{HTTP/1.1,[http/1.1]}{127.0.0.1:53190}
[junit4] 2> 481623 INFO (jetty-launcher-908-thread-2) [ ] o.e.j.s.Server Started @484820ms
[junit4] 2> 481623 INFO (jetty-launcher-908-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53190}
[junit4] 2> 481623 ERROR (jetty-launcher-908-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 481623 INFO (jetty-launcher-908-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 481623 INFO (jetty-launcher-908-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 481623 INFO (jetty-launcher-908-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 481623 INFO (jetty-launcher-908-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T11:29:09.681Z
[junit4] 2> 481624 INFO (jetty-launcher-908-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 481625 INFO (jetty-launcher-908-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 481626 INFO (jetty-launcher-908-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1276359a{HTTP/1.1,[http/1.1]}{127.0.0.1:53189}
[junit4] 2> 481626 INFO (jetty-launcher-908-thread-1) [ ] o.e.j.s.Server Started @484823ms
[junit4] 2> 481626 INFO (jetty-launcher-908-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53189}
[junit4] 2> 481626 ERROR (jetty-launcher-908-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 481626 INFO (jetty-launcher-908-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 481628 INFO (jetty-launcher-908-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d13a587{/solr,null,AVAILABLE}
[junit4] 2> 481628 INFO (jetty-launcher-908-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T11:29:09.687Z
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7241fba5{HTTP/1.1,[http/1.1]}{127.0.0.1:53192}
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-4) [ ] o.e.j.s.Server Started @484826ms
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53192}
[junit4] 2> 481629 ERROR (jetty-launcher-908-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T11:29:09.687Z
[junit4] 2> 481629 INFO (jetty-launcher-908-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@538b75f0{/solr,null,AVAILABLE}
[junit4] 2> 481630 INFO (jetty-launcher-908-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@267e8b0d{HTTP/1.1,[http/1.1]}{127.0.0.1:53193}
[junit4] 2> 481630 INFO (jetty-launcher-908-thread-3) [ ] o.e.j.s.Server Started @484826ms
[junit4] 2> 481630 INFO (jetty-launcher-908-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53193}
[junit4] 2> 481630 ERROR (jetty-launcher-908-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 481630 INFO (jetty-launcher-908-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 481630 INFO (jetty-launcher-908-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 481630 INFO (jetty-launcher-908-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 481630 INFO (jetty-launcher-908-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T11:29:09.688Z
[junit4] 2> 481631 INFO (jetty-launcher-908-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 481634 INFO (jetty-launcher-908-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 481634 INFO (jetty-launcher-908-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 481634 INFO (jetty-launcher-908-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 481658 INFO (jetty-launcher-908-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53187/solr
[junit4] 2> 481658 INFO (jetty-launcher-908-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53187/solr
[junit4] 2> 481659 INFO (jetty-launcher-908-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53187/solr
[junit4] 2> 481660 INFO (jetty-launcher-908-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53187/solr
[junit4] 2> 481834 INFO (jetty-launcher-908-thread-1) [n:127.0.0.1:53189_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 481834 INFO (jetty-launcher-908-thread-2) [n:127.0.0.1:53190_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 481834 INFO (jetty-launcher-908-thread-4) [n:127.0.0.1:53192_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 481834 INFO (jetty-launcher-908-thread-3) [n:127.0.0.1:53193_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 481835 INFO (jetty-launcher-908-thread-4) [n:127.0.0.1:53192_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53192_solr
[junit4] 2> 481835 INFO (jetty-launcher-908-thread-1) [n:127.0.0.1:53189_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53189_solr
[junit4] 2> 481835 INFO (jetty-launcher-908-thread-2) [n:127.0.0.1:53190_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53190_solr
[junit4] 2> 481836 INFO (jetty-launcher-908-thread-3) [n:127.0.0.1:53193_solr ] o.a
[...truncated too long message...]
lrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 564259 INFO (jetty-closer-909-thread-4) [ ] o.a.s.c.Overseer Overseer (id=98759065569198092-127.0.0.1:53189_solr-n_0000000001) closing
[junit4] 2> 564259 INFO (OverseerStateUpdate-98759065569198092-127.0.0.1:53189_solr-n_0000000001) [n:127.0.0.1:53189_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:53189_solr
[junit4] 2> 564259 INFO (jetty-closer-909-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 564260 INFO (jetty-closer-909-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 564263 INFO (zkCallback-929-thread-5-processing-n:127.0.0.1:53193_solr) [n:127.0.0.1:53193_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
[junit4] 2> 564263 INFO (zkCallback-930-thread-5-processing-n:127.0.0.1:53189_solr) [n:127.0.0.1:53189_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
[junit4] 2> 564266 INFO (zkCallback-929-thread-2-processing-n:127.0.0.1:53193_solr) [n:127.0.0.1:53193_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 564266 INFO (zkCallback-929-thread-5-processing-n:127.0.0.1:53193_solr) [n:127.0.0.1:53193_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53193_solr
[junit4] 2> 564267 WARN (zkCallback-929-thread-2-processing-n:127.0.0.1:53193_solr) [n:127.0.0.1:53193_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 565766 WARN (zkCallback-944-thread-2-processing-n:127.0.0.1:53192_solr) [n:127.0.0.1:53192_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 565766 WARN (zkCallback-927-thread-4-processing-n:127.0.0.1:53190_solr) [n:127.0.0.1:53190_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 565766 WARN (zkCallback-930-thread-5-processing-n:127.0.0.1:53189_solr) [n:127.0.0.1:53189_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 565766 INFO (jetty-closer-909-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@48b7342b{/solr,null,UNAVAILABLE}
[junit4] 2> 565766 INFO (jetty-closer-909-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6faa5c79{/solr,null,UNAVAILABLE}
[junit4] 2> 565767 INFO (jetty-closer-909-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@225d159a{/solr,null,UNAVAILABLE}
[junit4] 2> 565776 INFO (jetty-closer-909-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@538b75f0{/solr,null,UNAVAILABLE}
[junit4] 2> 565778 ERROR (SUITE-CollectionsAPIDistributedZkTest-seed#[AC327EC2E4BDF7B2]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 565778 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[AC327EC2E4BDF7B2]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53187 53187
[junit4] 2> 565779 INFO (Thread-1478) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53187 53187
[junit4] 2> 565894 WARN (Thread-1478) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 22 /solr/configs/conf
[junit4] 2> 18 /solr/aliases.json
[junit4] 2> 18 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 52 /solr/collections/addReplicaColl/state.json
[junit4] 2> 24 /solr/collections/nodes_used_collection/state.json
[junit4] 2> 24 /solr/collections/reloaded_collection/state.json
[junit4] 2> 18 /solr/clusterstate.json
[junit4] 2> 15 /solr/collections/acollectionafterbaddelete/state.json
[junit4] 2> 14 /solr/collections/halfdeletedcollection/state.json
[junit4] 2> 10 /solr/collections/onlyinzk/state.json
[junit4] 2> 6 /solr/collections/awhollynewcollection_0/state.json
[junit4] 2> 5 /solr/collections/halfcollectionblocker/state.json
[junit4] 2> 5 /solr/collections/created_and_deleted/state.json
[junit4] 2> 5 /solr/collections/halfcollectionblocker2/state.json
[junit4] 2> 5 /solr/collections/withconfigset2/state.json
[junit4] 2> 4 /solr/collections/halfcollection/state.json
[junit4] 2> 2 /solr/collections/addReplicaColl/leader_elect/shard1/election/98759065569198089-core_node10-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 358 /solr/collections
[junit4] 2> 18 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AC327EC2E4BDF7B2-001
[junit4] 2> Oct 02, 2017 11:30:33 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true): {}, locale=lt-LT, timezone=Asia/Sakhalin
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=288788872,total=429363200
[junit4] 2> NOTE: All tests run in this JVM: [OverseerRolesTest, TestCoreDiscovery, MoreLikeThisHandlerTest, CoreMergeIndexesAdminHandlerTest, TestLegacyTerms, JavabinLoaderTest, TestZkChroot, TestJoin, SimpleMLTQParserTest, TestSQLHandlerNonCloud, DataDrivenBlockJoinTest, CoreAdminCreateDiscoverTest, MultiThreadedOCPTest, TestTrie, BigEndianAscendingWordDeserializerTest, StatelessScriptUpdateProcessorFactoryTest, TestChildDocTransformer, TemplateUpdateProcessorTest, ShardRoutingCustomTest, BasicFunctionalityTest, TestCopyFieldCollectionResource, TestSolrCLIRunExample, DeleteNodeTest, ImplicitSnitchTest, LeaderInitiatedRecoveryOnShardRestartTest, SampleTest, TestRandomCollapseQParserPlugin, TestRestoreCore, SharedFSAutoReplicaFailoverUtilsTest, SolrCoreCheckLockOnStartupTest, TestStressUserVersions, TestConfigReload, TestAuthorizationFramework, ZkNodePropsTest, TermVectorComponentDistributedTest, FieldMutatingUpdateProcessorTest, SolrCmdDistributorTest, TestPostingsSolrHighlighter, ChangedSchemaMergeTest, TestSimpleTrackingShardHandler, TestCoreAdminApis, TestReload, OutOfBoxZkACLAndCredentialsProvidersTest, TestCharFilters, TestManagedSchemaThreadSafety, TestLegacyFieldReuse, HdfsCollectionsAPIDistributedZkTest, SpatialHeatmapFacetsTest, HdfsUnloadDistributedZkTest, MBeansHandlerTest, TestSolrJ, TestCollationField, TestCollationFieldDocValues, TestRandomFaceting, SearchHandlerTest, TestPartialUpdateDeduplication, TestFieldCacheWithThreads, TestRecovery, TestPivotHelperCode, DistributedQueryElevationComponentTest, BasicZkTest, TestFileDictionaryLookup, TestOverriddenPrefixQueryForCustomFieldType, TestConfigSetImmutable, TestLeaderElectionZkExpiry, DateRangeFieldTest, DistributedFacetPivotWhiteBoxTest, CursorMarkTest, DistributedFacetPivotSmallAdvancedTest, TestCloudManagedSchema, TestCollapseQParserPlugin, SolrIndexMetricsTest, TestCloudPseudoReturnFields, TestCollectionAPIs, SolrRequestParserTest, TermsComponentTest, TestPayloadScoreQParserPlugin, TestLMJelinekMercerSimilarityFactory, TestFieldTypeResource, TestJsonRequest, AutoCommitTest, OverseerCollectionConfigSetProcessorTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [161/733 (1!)] on J1 in 84.70s, 19 tests, 1 error <<< FAILURES!
[...truncated 39115 lines...]
-documentation-lint:
[echo] checking for broken html...
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///build/docs/sandbox/org/apache/lucene/document/FloatPointNearestNeighbor.html
[exec] BROKEN LINK: file:///build/docs/core/org/apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
[exec] BROKEN LINK: file:///build/docs/core/org/apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/build.xml:826: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/build.xml:142: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/build.xml:155: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/common-build.xml:2570: exec returned: 1
Total time: 80 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 221 -
Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/221/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
7 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Error from server at https://127.0.0.1:62036/solr/awhollynewcollection_0_shard2_replica_n2: ClusterState says we are the leader (https://127.0.0.1:62036/solr/awhollynewcollection_0_shard2_replica_n2), but locally we don't think so. Request came from null
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:62036/solr/awhollynewcollection_0_shard2_replica_n2: ClusterState says we are the leader (https://127.0.0.1:62036/solr/awhollynewcollection_0_shard2_replica_n2), but locally we don't think so. Request came from null
at __randomizedtesting.SeedInfo.seed([4497B8EBA4027415:CE2CC5FA2315B80]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:459)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:62036/solr/awhollynewcollection_0_shard2_replica_n2: ClusterState says we are the leader (https://127.0.0.1:62036/solr/awhollynewcollection_0_shard2_replica_n2), but locally we don't think so. Request came from null
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
FAILED: org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly
Error Message:
Unexpected number of elements in the group for intGSF: 6
Stack Trace:
java.lang.AssertionError: Unexpected number of elements in the group for intGSF: 6
at __randomizedtesting.SeedInfo.seed([4497B8EBA4027415:DF2CD6B3E95A464B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly(DocValuesNotIndexedTest.java:377)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
Error Message:
Could not find collection:testcollection
Stack Trace:
java.lang.AssertionError: Could not find collection:testcollection
at __randomizedtesting.SeedInfo.seed([4497B8EBA4027415:E76D164E23EA9EB0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.createCollection(TestCollectionsAPIViaSolrCloudCluster.java:91)
at org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete(TestCollectionsAPIViaSolrCloudCluster.java:161)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.core.BlobRepositoryCloudTest
Error Message:
Collection not found: col2
Stack Trace:
org.apache.solr.common.SolrException: Collection not found: col2
at __randomizedtesting.SeedInfo.seed([4497B8EBA4027415]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1139)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:822)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
at org.apache.solr.core.BlobRepositoryCloudTest.setupCluster(BlobRepositoryCloudTest.java:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.TestBlobHandler.doBlobHandlerTest
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([4497B8EBA4027415:A4569AB91FEE02E7]:0)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.getNodeName(JettySolrRunner.java:345)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:416)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestBlobHandler
Error Message:
18 threads leaked from SUITE scope at org.apache.solr.handler.TestBlobHandler: 1) Thread[id=25811, name=TEST-TestBlobHandler.doBlobHandlerTest-seed#[4497B8EBA4027415]-SendThread(127.0.0.1:58152), state=TIMED_WAITING, group=TGRP-TestBlobHandler] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 2) Thread[id=25801, name=qtp1394332085-25801, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=25794, name=qtp1394332085-25794, state=RUNNABLE, group=TGRP-TestBlobHandler] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=25798, name=qtp1394332085-25798, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=25807, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=25796, name=qtp1394332085-25796, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=25812, name=TEST-TestBlobHandler.doBlobHandlerTest-seed#[4497B8EBA4027415]-EventThread, state=WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 8) Thread[id=25818, name=zkCallback-4178-thread-2-processing-n:127.0.0.1:58177_, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:524) at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:467) at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454) at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:773) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56) at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348) at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269) at org.apache.solr.common.cloud.SolrZkClient$3$$Lambda$180/1126394310.run(Unknown Source) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$112/176648623.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 9) Thread[id=25820, name=zkCallback-4178-thread-4, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=25800, name=qtp1394332085-25800, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=25821, name=zkCallback-4178-thread-5, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 12) Thread[id=25806, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 13) Thread[id=25799, name=qtp1394332085-25799, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 14) Thread[id=25797, name=qtp1394332085-25797, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 15) Thread[id=25802, name=org.eclipse.jetty.server.session.HashSessionManager@5bc1960eTimer, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 16) Thread[id=25813, name=zkCallback-4178-thread-1, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 17) Thread[id=25795, name=qtp1394332085-25795-acceptor-0@5b10bd13-ServerConnector@3c6e2ebe{HTTP/1.1,[http/1.1]}{127.0.0.1:58177}, state=RUNNABLE, group=TGRP-TestBlobHandler] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 18) Thread[id=25819, name=zkCallback-4178-thread-3, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 18 threads leaked from SUITE scope at org.apache.solr.handler.TestBlobHandler:
1) Thread[id=25811, name=TEST-TestBlobHandler.doBlobHandlerTest-seed#[4497B8EBA4027415]-SendThread(127.0.0.1:58152), state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
2) Thread[id=25801, name=qtp1394332085-25801, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=25794, name=qtp1394332085-25794, state=RUNNABLE, group=TGRP-TestBlobHandler]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=25798, name=qtp1394332085-25798, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=25807, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=25796, name=qtp1394332085-25796, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=25812, name=TEST-TestBlobHandler.doBlobHandlerTest-seed#[4497B8EBA4027415]-EventThread, state=WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
8) Thread[id=25818, name=zkCallback-4178-thread-2-processing-n:127.0.0.1:58177_, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:524)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:467)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:454)
at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:773)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
at org.apache.solr.common.cloud.SolrZkClient$3$$Lambda$180/1126394310.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$112/176648623.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
9) Thread[id=25820, name=zkCallback-4178-thread-4, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
10) Thread[id=25800, name=qtp1394332085-25800, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
11) Thread[id=25821, name=zkCallback-4178-thread-5, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
12) Thread[id=25806, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
13) Thread[id=25799, name=qtp1394332085-25799, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
14) Thread[id=25797, name=qtp1394332085-25797, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
15) Thread[id=25802, name=org.eclipse.jetty.server.session.HashSessionManager@5bc1960eTimer, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
16) Thread[id=25813, name=zkCallback-4178-thread-1, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
17) Thread[id=25795, name=qtp1394332085-25795-acceptor-0@5b10bd13-ServerConnector@3c6e2ebe{HTTP/1.1,[http/1.1]}{127.0.0.1:58177}, state=RUNNABLE, group=TGRP-TestBlobHandler]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
18) Thread[id=25819, name=zkCallback-4178-thread-3, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([4497B8EBA4027415]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestBlobHandler
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=25811, name=TEST-TestBlobHandler.doBlobHandlerTest-seed#[4497B8EBA4027415]-SendThread(127.0.0.1:58152), state=TIMED_WAITING, group=TGRP-TestBlobHandler] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 2) Thread[id=25818, name=zkCallback-4178-thread-2, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=25820, name=zkCallback-4178-thread-4, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=25821, name=zkCallback-4178-thread-5, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=25802, name=org.eclipse.jetty.server.session.HashSessionManager@5bc1960eTimer, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=25813, name=zkCallback-4178-thread-1, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=25794, name=qtp1394332085-25794, state=RUNNABLE, group=TGRP-TestBlobHandler] at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method) at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:203) at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:257) at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:116) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=25819, name=zkCallback-4178-thread-3, state=TIMED_WAITING, group=TGRP-TestBlobHandler] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=25811, name=TEST-TestBlobHandler.doBlobHandlerTest-seed#[4497B8EBA4027415]-SendThread(127.0.0.1:58152), state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
2) Thread[id=25818, name=zkCallback-4178-thread-2, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=25820, name=zkCallback-4178-thread-4, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=25821, name=zkCallback-4178-thread-5, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=25802, name=org.eclipse.jetty.server.session.HashSessionManager@5bc1960eTimer, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=25813, name=zkCallback-4178-thread-1, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=25794, name=qtp1394332085-25794, state=RUNNABLE, group=TGRP-TestBlobHandler]
at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)
at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:203)
at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:257)
at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:116)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=25819, name=zkCallback-4178-thread-3, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([4497B8EBA4027415]:0)
Build Log:
[...truncated 11723 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4497B8EBA4027415-001/init-core-data-001
[junit4] 2> 292743 WARN (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=110 numCloses=110
[junit4] 2> 292744 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 292747 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 292747 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 292749 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4497B8EBA4027415-001/tempDir-001
[junit4] 2> 292749 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 292749 INFO (Thread-408) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 292749 INFO (Thread-408) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 292751 ERROR (Thread-408) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 292858 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:62034
[junit4] 2> 292989 INFO (jetty-launcher-392-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 292990 INFO (jetty-launcher-392-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 292990 INFO (jetty-launcher-392-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 292990 INFO (jetty-launcher-392-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 292993 INFO (jetty-launcher-392-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56449de6{/solr,null,AVAILABLE}
[junit4] 2> 292994 INFO (jetty-launcher-392-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19a1ae7b{/solr,null,AVAILABLE}
[junit4] 2> 293000 INFO (jetty-launcher-392-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@99f2f0d{/solr,null,AVAILABLE}
[junit4] 2> 293003 INFO (jetty-launcher-392-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b9e99af{/solr,null,AVAILABLE}
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4821167a{SSL,[ssl, http/1.1]}{127.0.0.1:62036}
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-1) [ ] o.e.j.s.Server Started @296229ms
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62036}
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@33980880{SSL,[ssl, http/1.1]}{127.0.0.1:62039}
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3362af8c{SSL,[ssl, http/1.1]}{127.0.0.1:62038}
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-2) [ ] o.e.j.s.Server Started @296229ms
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-3) [ ] o.e.j.s.Server Started @296229ms
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62038}
[junit4] 2> 293004 INFO (jetty-launcher-392-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62039}
[junit4] 2> 293005 ERROR (jetty-launcher-392-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 293005 ERROR (jetty-launcher-392-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 293005 ERROR (jetty-launcher-392-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T00:41:58.173Z
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T00:41:58.173Z
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T00:41:58.173Z
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7a86d2eb{SSL,[ssl, http/1.1]}{127.0.0.1:62037}
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-4) [ ] o.e.j.s.Server Started @296230ms
[junit4] 2> 293005 INFO (jetty-launcher-392-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62037}
[junit4] 2> 293005 ERROR (jetty-launcher-392-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 293006 INFO (jetty-launcher-392-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 293006 INFO (jetty-launcher-392-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 293006 INFO (jetty-launcher-392-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 293006 INFO (jetty-launcher-392-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T00:41:58.174Z
[junit4] 2> 293009 INFO (jetty-launcher-392-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 293009 INFO (jetty-launcher-392-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 293009 INFO (jetty-launcher-392-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 293009 INFO (jetty-launcher-392-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 293023 INFO (jetty-launcher-392-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62034/solr
[junit4] 2> 293023 INFO (jetty-launcher-392-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62034/solr
[junit4] 2> 293025 INFO (jetty-launcher-392-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62034/solr
[junit4] 2> 293026 INFO (jetty-launcher-392-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62034/solr
[junit4] 2> 293204 INFO (jetty-launcher-392-thread-4) [n:127.0.0.1:62037_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 293204 INFO (jetty-launcher-392-thread-1) [n:127.0.0.1:62036_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 293205 INFO (jetty-launcher-392-thread-2) [n:127.0.0.1:62039_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 293205 INFO (jetty-launcher-392-thread-4) [n:127.0.0.1:62037_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62037_solr
[junit4] 2> 293206 INFO (jetty-launcher-392-thread-1) [n:127.0.0.1:62036_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62036_solr
[junit4] 2> 293206 INFO (jetty-launcher-392-thread-2) [n:127.0.0.1:62039_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62039_solr
[junit4] 2> 293207 INFO (jetty-launcher-392-thread-4) [n:127.0.0.1:62037_solr ] o.a.s.c.Overseer Overseer (id=98756520700739594-127.0.0.1:62037_solr-n_0000000000) starting
[junit4] 2> 293208 INFO (zkCallback-412-thread-1-processing-n:127.0.0.1:62036_solr) [n:127.0.0.1:62036_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 293209 INFO (zkCallback-414-thread-1-processing-n:127.0.0.1:62039_solr) [n:127.0.0.1:62039_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 293210 INFO (zkCallback-413-thread-1-processing-n:127.0.0.1:62037_solr) [n:127.0.0.1:62037_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 293211 INFO (zkCallback-412-thread-1-processing-n:127.0.0.1:62036_solr) [n:127.0.0.1:62036_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 293211 INFO (zkCallback-414-thread-1-processing-n:127.0.0.1:62039_solr) [n:127.0.0.1:62039_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 293211 INFO (zkCallback-413-thread-1-processing-n:127.0.0.1:62037_solr) [n:127.0.0.1:62037_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 293222 INFO (jetty-launcher-392-thread-4) [n:127.0.0.1:62037_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62037_solr
[junit4] 2> 293225 INFO (zkCallback-412-thread-1-processing-n:127.0.0.1:62036_solr) [n:127.0.0.1:62036_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 293225 INFO (zkCallback-414-thread-1-processing-n:127.0.0.1:62039_solr) [n:127.0.0.1:62039_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 293225 INFO (zkCallback-413-thread-1-processing-n:127.0.0.1:62037_solr) [n:127.0.0.1:62037_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 293275 INFO (jetty-launcher-392-thread-3) [n:127.0.0.1:62038_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 293278 INFO (jetty-launcher-392-thread-3) [n:127.0.0.1:62038_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 293280 INFO (jetty-launcher-392-thread-3) [n:127.0.0.1:62038_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62038_solr
[junit4] 2> 293282 INFO (zkCallback-414-thread-1-processing-n:127.0.0.1:62039_solr) [n:127.0.0.1:62039_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 293282 INFO (zkCallback-411-thread-1-processing-n:127.0.0.1:62038_solr) [n:127.0.0.1:62038_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 293297 INFO (zkCallback-413-thread-1-processing-n:127.0.0.1:62037_solr) [n:127.0.0.1:62037_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 293297 INFO (zkCallback-412-thread-1-processing-n:127.0.0.1:62036_solr) [n:127.0.0.1:62036_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 293321 INFO (jetty-launcher-392-thread-1) [n:127.0.0.1:62036_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293334 INFO (jetty-launcher-392-thread-1) [n:127.0.0.1:62036_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293334 INFO (jetty-launcher-392-thread-1) [n:127.0.0.1:62036_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293335 INFO (jetty-launcher-392-thread-1) [n:127.0.0.1:62036_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4497B8EBA4027415-001/tempDir-001/node1
[junit4] 2> 293410 INFO (jetty-launcher-392-thread-4) [n:127.0.0.1:62037_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293461 INFO (jetty-launcher-392-thread-4) [n:127.0.0.1:62037_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293461 INFO (jetty-launcher-392-thread-4) [n:127.0.0.1:62037_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293465 INFO (jetty-launcher-392-thread-3) [n:127.0.0.1:62038_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293466 INFO (jetty-launcher-392-thread-4) [n:127.0.0.1:62037_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4497B8EBA4027415-001/tempDir-001/node4
[junit4] 2> 293466 INFO (jetty-launcher-392-thread-2) [n:127.0.0.1:62039_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293510 INFO (jetty-launcher-392-thread-3) [n:127.0.0.1:62038_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293510 INFO (jetty-launcher-392-thread-3) [n:127.0.0.1:62038_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293516 INFO (jetty-launcher-392-thread-2) [n:127.0.0.1:62039_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293516 INFO (jetty-launcher-392-thread-2) [n:127.0.0.1:62039_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@31d8b059
[junit4] 2> 293519 INFO (jetty-launcher-392-thread-3) [n:127.0.0.1:62038_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4497B8EBA4027415-001/tempDir-001/node3
[junit4] 2> 293520 INFO (jetty-launcher-392-thread-2) [n:127.0.0.1:62039_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_4497B8EBA4027415-001/tempDir-001/node2
[junit4] 2> 293584 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 293585 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4497B8EBA4027415]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62034/solr ready
[junit4] 2> 293614 INFO (TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[4497B8EBA4027415]) [ ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionOnlyInZk
[junit4] 2> 293615 INFO (TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[4497B8EBA4027415]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 293636 INFO (qtp2064757925-2231) [n:127.0.0.1:62036_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=onlyinzk&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 293643 INFO (qtp2064757925-2231) [n:127.0.0.1:62036_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=onlyinzk&action=DELETE&wt=javabin&version=2} status=0 QTime=7
[junit4] 2> 293644 INFO (qtp2064757925-2232) [n:127.0.0.1:62036_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 293644 INFO (qtp2064757925-2232) [n:127.0.0.1:62036_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 293645 INFO (qtp2064757925-2233) [n:127.0.0.1:62036_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=onlyinzk&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 293648 INFO (OverseerThreadFactory-791-thread-2-processing-n:127.0.0.1:62037_solr) [n:127.0.0.1:62037_solr ] o.a.s.c.CreateCollectionCmd Create collection onlyinzk
[junit4] 2> 293648 INFO (OverseerCollectionConfigSetProcessor-98756520700739594-127.0.0.1:62037_solr-n_0000000000) [n:127.0.0.1:62037_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 293762 INFO (OverseerStateUpdate-98756520700739594-127.0.0.1:62037_solr-n_0000000000) [n:127.0.0.1:62037_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"onlyinzk",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"onlyinzk_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:62038/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 293768 INFO (OverseerStateUpdate-98756520700739594-127.0.0.1:62037_solr-n_0000000000) [n:127.0.0.1:62037_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"onlyinzk",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"onlyinzk_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:62039/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 294026 INFO (qtp506811564-2250) [n:127.0.0.1:62038_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=onlyinzk_shard1_replica_n1&action=CREATE&numShards=2&collection=onlyinzk&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 294026 INFO (qtp463452013-2258) [n:127.0.0.1:62039_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=onlyinzk_shard2_replica_n2&action=CREATE&numShards=2&collection=onlyinzk&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 294027 INFO (qtp506811564-2250) [n:127.0.0.1:62038_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 294027 INFO (qtp463452013-2258) [n:127.0.0.1:62039_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 294147 INFO (zkCallback-414-thread-1-processing-n:127.0.0.1:62039_solr) [n:127.0.0.1:62039_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 294147 INFO (zkCallback-411-thread-1-processing-n:127.0.0.1:62038_solr) [n:127.0.0.1:62038_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 294148 INFO (zkCallback-411-thread-2-processing-n:127.0.0.1:62038_solr) [n:127.0.0.1:62038_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 294149 INFO (zkCallback-414-thread-2-processing-n:127.0.0.1:62039_solr) [n:127.0.0.1:62039_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 295062 INFO (qtp506811564-2250) [n:127.0.0.1:62038_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 295071 INFO (qtp463452013-2258) [n:127.0.0.1:62039_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 295076 INFO (qtp506811564-2250) [n:127.0.0.1:62038_solr c:onlyinzk s:shard1 r:
[...truncated too long message...]
ITING, group=TGRP-TestBlobHandler]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 3) Thread[id=25820, name=zkCallback-4178-thread-4, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 4) Thread[id=25821, name=zkCallback-4178-thread-5, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 5) Thread[id=25802, name=org.eclipse.jetty.server.session.HashSessionManager@5bc1960eTimer, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 6) Thread[id=25813, name=zkCallback-4178-thread-1, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 7) Thread[id=25794, name=qtp1394332085-25794, state=RUNNABLE, group=TGRP-TestBlobHandler]
[junit4] > at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)
[junit4] > at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:203)
[junit4] > at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:257)
[junit4] > at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
[junit4] > at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
[junit4] > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:116)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] > at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 8) Thread[id=25819, name=zkCallback-4178-thread-3, state=TIMED_WAITING, group=TGRP-TestBlobHandler]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([4497B8EBA4027415]:0)
[junit4] Completed [586/733 (5!)] on J0 in 27.43s, 1 test, 3 errors <<< FAILURES!
[...truncated 37732 lines...]
-documentation-lint:
[echo] checking for broken html...
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///build/docs/sandbox/org/apache/lucene/document/FloatPointNearestNeighbor.html
[exec] BROKEN LINK: file:///build/docs/core/org/apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
[exec] BROKEN LINK: file:///build/docs/core/org/apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/build.xml:826: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/build.xml:142: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/build.xml:155: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/lucene/common-build.xml:2570: exec returned: 1
Total time: 85 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any