You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/10/31 12:07:53 UTC
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 3640
- Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/3640/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1
Error Message:
CollectionStateWatcher not notified of stateformat=1 collection creation
Stack Trace:
java.lang.AssertionError: CollectionStateWatcher not notified of stateformat=1 collection creation
at __randomizedtesting.SeedInfo.seed([3E0FD36200A7DD4E:59C8CF8CF41FF9EF]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1(TestCollectionStateWatchers.java:290)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 13107 lines...]
[junit4] Suite: org.apache.solr.common.cloud.TestCollectionStateWatchers
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/init-core-data-001
[junit4] 2> 0 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.e.j.u.log Logging initialized @9413ms
[junit4] 2> 12 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 91 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001
[junit4] 2> 123 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 132 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 132 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 337 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:64080
[junit4] 2> 603 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 4021 INFO (jetty-launcher-2-thread-3) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 4021 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 4021 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 4021 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 4199 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6bf64618{/solr,null,AVAILABLE}
[junit4] 2> 4202 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4cba532{/solr,null,AVAILABLE}
[junit4] 2> 4212 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5bb91f87{/solr,null,AVAILABLE}
[junit4] 2> 4200 INFO (jetty-launcher-2-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36107174{/solr,null,AVAILABLE}
[junit4] 2> 4273 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@49e4cb6c{HTTP/1.1,[http/1.1]}{127.0.0.1:64085}
[junit4] 2> 4273 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.Server Started @13695ms
[junit4] 2> 4273 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64085}
[junit4] 2> 4276 INFO (jetty-launcher-2-thread-3) [ ] o.e.j.s.ServerConnector Started ServerConnector@6bfc906d{HTTP/1.1,[http/1.1]}{127.0.0.1:64087}
[junit4] 2> 4281 INFO (jetty-launcher-2-thread-3) [ ] o.e.j.s.Server Started @13703ms
[junit4] 2> 4277 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@4f5d38e6{HTTP/1.1,[http/1.1]}{127.0.0.1:64088}
[junit4] 2> 4283 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.Server Started @13705ms
[junit4] 2> 4277 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.ServerConnector Started ServerConnector@4aecdecf{HTTP/1.1,[http/1.1]}{127.0.0.1:64086}
[junit4] 2> 4283 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.Server Started @13705ms
[junit4] 2> 4283 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64088}
[junit4] 2> 4283 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64086}
[junit4] 2> 4281 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64087}
[junit4] 2> 4358 ERROR (jetty-launcher-2-thread-4) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4358 ERROR (jetty-launcher-2-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4358 ERROR (jetty-launcher-2-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4358 ERROR (jetty-launcher-2-thread-3) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4364 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.0.0
[junit4] 2> 4364 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.0.0
[junit4] 2> 4366 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.0.0
[junit4] 2> 4364 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.0.0
[junit4] 2> 4376 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4376 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4376 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4376 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4376 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4376 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4378 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4377 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 4486 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-31T11:43:17.602Z
[junit4] 2> 4486 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-31T11:43:17.602Z
[junit4] 2> 4486 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-31T11:43:17.602Z
[junit4] 2> 4486 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-31T11:43:17.602Z
[junit4] 2> 4802 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 4812 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4825 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4827 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 4833 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 7095 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64080/solr
[junit4] 2> 7098 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64080/solr
[junit4] 2> 7100 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64080/solr
[junit4] 2> 7100 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64080/solr
[junit4] 2> 7508 INFO (jetty-launcher-2-thread-1) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:64085_solr
[junit4] 2> 7521 INFO (jetty-launcher-2-thread-1) [n:127.0.0.1:64085_solr ] o.a.s.c.Overseer Overseer (id=96856584588689419-127.0.0.1:64085_solr-n_0000000000) starting
[junit4] 2> 7529 INFO (jetty-launcher-2-thread-2) [n:127.0.0.1:64088_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64088_solr
[junit4] 2> 7533 INFO (jetty-launcher-2-thread-3) [n:127.0.0.1:64087_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64087_solr
[junit4] 2> 7547 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:64086_solr) [n:127.0.0.1:64086_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 7549 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 7547 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 7551 INFO (zkCallback-22-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 7645 INFO (jetty-launcher-2-thread-4) [n:127.0.0.1:64086_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64086_solr
[junit4] 2> 7649 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 7649 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:64086_solr) [n:127.0.0.1:64086_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 7649 INFO (zkCallback-22-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 7649 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 8123 INFO (jetty-launcher-2-thread-3) [n:127.0.0.1:64087_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node3/.
[junit4] 2> 8124 INFO (jetty-launcher-2-thread-2) [n:127.0.0.1:64088_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/.
[junit4] 2> 8127 INFO (jetty-launcher-2-thread-4) [n:127.0.0.1:64086_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node4/.
[junit4] 2> 8767 INFO (jetty-launcher-2-thread-1) [n:127.0.0.1:64085_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64085_solr
[junit4] 2> 8776 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:64086_solr) [n:127.0.0.1:64086_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 8777 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 8778 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 8778 INFO (zkCallback-22-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 8897 INFO (jetty-launcher-2-thread-1) [n:127.0.0.1:64085_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node1/.
[junit4] 2> 8985 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 9095 INFO (TEST-TestCollectionStateWatchers.testWatchesWorkForStateFormat1-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testWatchesWorkForStateFormat1
[junit4] 2> 11262 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=33f0fcff-cf46-4514-84fe-3e23c57299ee&replicationFactor=1&collection.configName=config&name=stateformat1&action=CREATE&numShards=1&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 11303 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=33f0fcff-cf46-4514-84fe-3e23c57299ee&replicationFactor=1&collection.configName=config&name=stateformat1&action=CREATE&numShards=1&stateFormat=1&wt=javabin&version=2} status=0 QTime=543
[junit4] 2> 11333 INFO (OverseerThreadFactory-24-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection stateformat1
[junit4] 2> 11550 INFO (qtp1219989139-54) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&qt=/admin/cores&collection.configName=config&newCollection=true&name=stateformat1_shard1_replica1&action=CREATE&numShards=1&collection=stateformat1&shard=shard1&wt=javabin&version=2} status=0 QTime=16
[junit4] 2> 11567 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation core create command async=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&qt=/admin/cores&collection.configName=config&newCollection=true&name=stateformat1_shard1_replica1&action=CREATE&numShards=1&collection=stateformat1&shard=shard1&wt=javabin&version=2
[junit4] 2> 11669 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 11670 INFO (qtp1219989139-54) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 11671 INFO (qtp1219989139-54) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 11674 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 12683 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 12684 INFO (qtp1219989139-55) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 12685 INFO (qtp1219989139-55) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 12688 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 12809 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 13077 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema [stateformat1_shard1_replica1] Schema name=test
[junit4] 2> 13697 INFO (qtp1219989139-56) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 13697 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 13697 INFO (qtp1219989139-56) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 13700 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 14708 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 14708 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 14708 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 14710 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 14994 WARN (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema [stateformat1_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 15005 WARN (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 15006 WARN (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 15009 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 15083 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'stateformat1_shard1_replica1' using configuration from collection stateformat1
[junit4] 2> 15330 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SolrCore [[stateformat1_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/stateformat1_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/./stateformat1_shard1_replica1/data/]
[junit4] 2> 15714 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 15714 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 15722 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 15725 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 16726 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 16726 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 16737 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 16740 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 17734 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 17734 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 17746 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 17768 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=22
[junit4] 2> 18744 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 18744 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 18777 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 18780 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 19751 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 19752 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 19785 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 19791 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 19970 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 19970 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 20013 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 20013 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 20181 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@d4fba9b[stateformat1_shard1_replica1] main]
[junit4] 2> 20256 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 20358 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 20533 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 20696 INFO (searcherExecutor-27-thread-1-processing-x:stateformat1_shard1_replica1 r:core_node1 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE n:127.0.0.1:64088_solr s:shard1 c:stateformat1) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SolrCore [stateformat1_shard1_replica1] Registered new searcher Searcher@d4fba9b[stateformat1_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 20698 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1549705374770135040
[junit4] 2> 20756 INFO (qtp1219989139-56) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 20756 INFO (qtp1219989139-56) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 20771 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 20771 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 20778 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64088/solr/stateformat1_shard1_replica1/
[junit4] 2> 20785 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 20785 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:64088/solr/stateformat1_shard1_replica1/ has no replicas
[junit4] 2> 20798 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 20802 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 20943 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64088/solr/stateformat1_shard1_replica1/ shard1
[junit4] 2> 21082 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 21770 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
[junit4] 2> 21770 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 21804 INFO (OverseerThreadFactory-24-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 21810 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 21824 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=14
[junit4] 2> 21834 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 21840 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 21844 INFO (TEST-TestCollectionStateWatchers.testWatchesWorkForStateFormat1-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testWatchesWorkForStateFormat1
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestCollectionStateWatchers -Dtests.method=testWatchesWorkForStateFormat1 -Dtests.seed=3E0FD36200A7DD4E -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=America/Dawson -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 12.8s J0 | TestCollectionStateWatchers.testWatchesWorkForStateFormat1 <<<
[junit4] > Throwable #1: java.lang.AssertionError: CollectionStateWatcher not notified of stateformat=1 collection creation
[junit4] > at __randomizedtesting.SeedInfo.seed([3E0FD36200A7DD4E:59C8CF8CF41FF9EF]:0)
[junit4] > at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1(TestCollectionStateWatchers.java:290)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 21898 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeletionsTriggerWatches
[junit4] 2> 21911 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=config&name=tobedeleted&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 21921 INFO (OverseerThreadFactory-24-thread-2-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection tobedeleted
[junit4] 2> 21923 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 22152 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=config&newCollection=true&name=tobedeleted_shard1_replica1&action=CREATE&numShards=1&collection=tobedeleted&shard=shard1&wt=javabin&version=2
[junit4] 2> 22272 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
[junit4] 2> 23198 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 23298 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema [tobedeleted_shard1_replica1] Schema name=test
[junit4] 2> 23513 WARN (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema [tobedeleted_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 23518 WARN (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 23519 WARN (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 23527 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 23531 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'tobedeleted_shard1_replica1' using configuration from collection tobedeleted
[junit4] 2> 23534 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore [[tobedeleted_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/tobedeleted_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data/]
[junit4] 2> 23573 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 23575 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 23581 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 23584 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 23586 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@64360116[tobedeleted_shard1_replica1] main]
[junit4] 2> 23590 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 23593 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 23593 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 23594 INFO (searcherExecutor-32-thread-1-processing-n:127.0.0.1:64088_solr x:tobedeleted_shard1_replica1 s:shard1 c:tobedeleted r:core_node1) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore [tobedeleted_shard1_replica1] Registered new searcher Searcher@64360116[tobedeleted_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 23595 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1549705377806811136
[junit4] 2> 23616 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 23618 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 23618 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64088/solr/tobedeleted_shard1_replica1/
[junit4] 2> 23619 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 23619 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:64088/solr/tobedeleted_shard1_replica1/ has no replicas
[junit4] 2> 23630 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64088/solr/tobedeleted_shard1_replica1/ shard1
[junit4] 2> 23743 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
[junit4] 2> 23793 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 23801 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=config&newCollection=true&name=tobedeleted_shard1_replica1&action=CREATE&numShards=1&collection=tobedeleted&shard=shard1&wt=javabin&version=2} status=0 QTime=1649
[junit4] 2> 23814 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 23919 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
[junit4] 2> 23936 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000001 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 24822 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=config&name=tobedeleted&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2911
[junit4] 2> 24829 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=tobedeleted&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 24842 INFO (OverseerThreadFactory-24-thread-3-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 24848 INFO (qtp1219989139-45) [n:127.0.0.1:64088_solr ] o.a.s.c.SolrCore [tobedeleted_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@75c1118d
[junit4] 2> 24893 INFO (qtp1219989139-45) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=tobedeleted_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=46
[junit4] 2> 25029 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
[junit4] 2> 25639 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=tobedeleted&action=DELETE&wt=javabin&version=2} status=0 QTime=810
[junit4] 2> 25640 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDeletionsTriggerWatches
[junit4] 2> 25686 INFO (TEST-TestCollectionStateWatchers.testPredicateFailureTimesOut-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testPredicateFailureTimesOut
[junit4] 2> 26716 INFO (TEST-TestCollectionStateWatchers.testPredicateFailureTimesOut-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testPredicateFailureTimesOut
[junit4] 2> 26753 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForStateChecksCurrentState
[junit4] 2> 26768 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&replicationFactor=1&collection.configName=config&name=waitforstate&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 26772 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&replicationFactor=1&collection.configName=config&name=waitforstate&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 26775 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 26783 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=7
[junit4] 2> 26791 INFO (OverseerThreadFactory-24-thread-4-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection waitforstate
[junit4] 2> 26794 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000003 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 26938 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&qt=/admin/cores&collection.configName=config&newCollection=true&name=waitforstate_shard1_replica1&action=CREATE&numShards=1&collection=waitforstate&shard=shard1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 26938 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CoreAdminOperation core create command async=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&qt=/admin/cores&collection.configName=config&newCollection=true&name=waitforstate_shard1_replica1&action=CREATE&numShards=1&collection=waitforstate&shard=shard1&wt=javabin&version=2
[junit4] 2> 26941 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381
[junit4] 2> 26942 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 27057 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/waitforstate/state.json] for collection [waitforstate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 27792 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 27799 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 27950 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381
[junit4] 2> 27950 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 27984 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 28044 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema [waitforstate_shard1_replica1] Schema name=test
[junit4] 2> 28200 WARN (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema [waitforstate_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 28203 WARN (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 28204 WARN (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 28205 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 28212 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'waitforstate_shard1_replica1' using configuration from collection waitforstate
[junit4] 2> 28213 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore [[waitforstate_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node3/waitforstate_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node3/./waitforstate_shard1_replica1/data/]
[junit4] 2> 28255 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 28255 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 28260 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 28260 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 28261 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@16448e0e[waitforstate_shard1_replica1] main]
[junit4] 2> 28264 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 28265 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 28265 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 28266 INFO (searcherExecutor-37-thread-1-processing-x:waitforstate_shard1_replica1 r:core_node1 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE n:127.0.0.1:64087_solr s:shard1 c:waitforstate) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore [waitforstate_shard1_replica1] Registered new searcher Searcher@16448e0e[waitforstate_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 28266 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1549705382705758208
[junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64087/solr/waitforstate_shard1_replica1/
[junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:64087/solr/waitforstate_shard1_replica1/ has no replicas
[junit4] 2> 28303 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64087/solr/waitforstate_shard1_replica1/ shard1
[junit4] 2> 28420 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/waitforstate/state.json] for collection [waitforstate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 28464 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 28583 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/waitforstate/state.json] for collection [waitforstate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 28803 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 28807 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 28955 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381
[junit4] 2> 28956 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 28965 INFO (OverseerThreadFactory-24-thread-4-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000005 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 29820 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 29823 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 29826 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 29827 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 29858 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testWaitForStateChecksCurrentState
[junit4] 2> 29892 INFO (TEST-TestCollectionStateWatchers.testCanWaitForNonexistantCollection-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCanWaitForNonexistantCollection
[junit4] 2> 29906 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&replicationFactor=1&collection.configName=config&name=delayed&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 29912 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&replicationFactor=1&collection.configName=config&name=delayed&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 29914 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 29921 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 29923 INFO (OverseerThreadFactory-24-thread-5-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection delayed
[junit4] 2> 29925 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000005 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 30046 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
[junit4] 2> 30163 INFO (qtp207420342-49) [n:127.0.0.1:64085_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&qt=/admin/cores&collection.configName=config&newCollection=true&name=delayed_shard1_replica1&action=CREATE&numShards=1&collection=delayed&shard=shard1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 30163 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr ] o.a.s.h.a.CoreAdminOperation core create command async=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&qt=/admin/cores&collection.configName=config&newCollection=true&name=delayed_shard1_replica1&action=CREATE&numShards=1&collection=delayed&shard=shard1&wt=javabin&version=2
[junit4] 2> 30166 INFO (qtp207420342-50) [n:127.0.0.1:64085_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637
[junit4] 2> 30167 INFO (qtp207420342-50) [n:127.0.0.1:64085_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 30288 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
[junit4] 2> 30288 INFO (zkCallback-22-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
[junit4] 2> 30927 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 30930 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 31172 INFO (qtp207420342-51) [n:127.0.0.1:64085_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637
[junit4] 2> 31172 INFO (qtp207420342-51) [n:127.0.0.1:64085_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 31189 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 31228 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema [delayed_shard1_replica1] Schema name=test
[junit4] 2> 31347 WARN (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema [delayed_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 31351 WARN (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 31351 WARN (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 31352 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 31354 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'delayed_shard1_replica1' using configuration from collection delayed
[junit4] 2> 31355 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SolrCore [[delayed_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node1/delayed_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node1/./delayed_shard1_replica1/data/]
[junit4] 2> 31375 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 31375 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 31378 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 31378 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 31380 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@736a647b[delayed_shard1_replica1] main]
[junit4] 2> 31383 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 31384 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 31384 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 31385 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1549705385976266752
[junit4] 2> 31385 INFO (searcherExecutor-42-thread-1-processing-x:delayed_shard1_replica1 r:core_node1 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE n:127.0.0.1:64085_solr s:shard1 c:delayed) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SolrCore [delayed_shard1_replica1] Registered new searcher Searcher@736a647b[delayed_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 31401 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 31402 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 31402 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64085/solr/delayed_shard1_replica1/
[junit4] 2> 31402 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 31402 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:64085/solr/delayed_shard1_replica1/ has no replicas
[junit4] 2> 31417 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64085/solr/delayed_shard1_replica1/ shard1
[junit4] 2> 31538 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
[junit4] 2> 31538 INFO (zkCallback-22-thread-3-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
[junit4] 2> 31595 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 31724 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
[junit4] 2> 31724 INFO (zkCallback-22-thread-2-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
[junit4] 2> 31959 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 31962 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 32176 INFO (qtp207420342-52) [n:127.0.0.1:64085_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637
[junit4] 2> 32177 INFO (qtp207420342-52) [n:127.0.0.1:64085_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 32199 INFO (OverseerThreadFactory-24-thread-5-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 32970 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 32973 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 32975 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 32976 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 32977 INFO (TEST-TestCollectionStateWatchers.testCanWaitForNonexistantCollection-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCanWaitForNonexistantCollection
[junit4] 2> 33014 INFO (TEST-TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testStateWatcherChecksCurrentStateOnRegister
[junit4] 2> 33029 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=76d205a3-9443-40fb-8132-51a0c2a82578&replicationFactor=1&collection.configName=config&name=currentstate&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 33034 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=76d205a3-9443-40fb-8132-51a0c2a82578&replicationFactor=1&collection.configName=config&name=currentstate&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 33039 INFO (OverseerThreadFactory-24-thread-5-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection currentstate
[junit4] 2> 33041 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 33043 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d205a3-9443-40fb-8132-51a0c2a82578&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 33049 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d205a3-9443-40fb-8132-51a0c2a82578&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=5
[junit4] 2> 33275 INFO (qtp270658667-37) [n:127.0.0.1:64086_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=76d205a3-9443-40fb-8132-51a0c2a825781003430813096675&qt=/admin/cores&collection.configName=config&newCollection=true&name=currentstate_shard1_replica1&action=CREATE&numShards=1&collection=currentstate&shard=shard1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 33275 INFO (parallelCoreAdminExecutor-18-thread-1-processing-n:127.0.0.1:64086_s
[...truncated too long message...]
200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSimpleCollectionWatch
[junit4] 2> 45905 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@6bfc906d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 45905 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1838003778
[junit4] 2> 45905 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@78f47f44{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 45905 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@4f5d38e6{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 45905 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=449129643
[junit4] 2> 45906 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=851899165
[junit4] 2> 45909 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 45909 INFO (zkCallback-43-thread-1-processing-n:127.0.0.1:64168_solr) [n:127.0.0.1:64168_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 45909 INFO (zkCallback-21-thread-2-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 45914 INFO (coreCloseExecutor-132-thread-1) [n:127.0.0.1:64168_solr c:falsepredicate s:shard3 r:core_node1 x:falsepredicate_shard3_replica1] o.a.s.c.SolrCore [falsepredicate_shard3_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@4d4500e
[junit4] 2> 45915 INFO (coreCloseExecutor-132-thread-2) [n:127.0.0.1:64168_solr c:currentstate s:shard1 r:core_node1 x:currentstate_shard1_replica1] o.a.s.c.SolrCore [currentstate_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@6f044d63
[junit4] 2> 45917 INFO (coreCloseExecutor-134-thread-1) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore [waitforstate_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@18e1ebb
[junit4] 2> 45917 INFO (coreCloseExecutor-134-thread-2) [n:127.0.0.1:64087_solr c:falsepredicate s:shard4 r:core_node4 x:falsepredicate_shard4_replica1] o.a.s.c.SolrCore [falsepredicate_shard4_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@17a9debb
[junit4] 2> 45919 INFO (coreCloseExecutor-133-thread-1) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SolrCore [stateformat1_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@32481761
[junit4] 2> 45919 INFO (coreCloseExecutor-133-thread-2) [n:127.0.0.1:64088_solr c:falsepredicate s:shard2 r:core_node3 x:falsepredicate_shard2_replica1] o.a.s.c.SolrCore [falsepredicate_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@29806b8b
[junit4] 2> 45922 INFO (coreCloseExecutor-132-thread-3) [n:127.0.0.1:64168_solr c:testcollection s:shard4 r:core_node3 x:testcollection_shard4_replica1] o.a.s.c.SolrCore [testcollection_shard4_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@3ea98e65
[junit4] 2> 45923 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [3])
[junit4] 2> 45924 INFO (zkCallback-43-thread-1-processing-n:127.0.0.1:64168_solr) [n:127.0.0.1:64168_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [3])
[junit4] 2> 45924 INFO (zkCallback-21-thread-2-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [3])
[junit4] 2> 45924 INFO (coreCloseExecutor-134-thread-3) [n:127.0.0.1:64087_solr c:testcollection s:shard3 r:core_node2 x:testcollection_shard3_replica1] o.a.s.c.SolrCore [testcollection_shard3_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@337bce17
[junit4] 2> 45924 INFO (coreCloseExecutor-133-thread-3) [n:127.0.0.1:64088_solr c:testcollection s:shard2 r:core_node1 x:testcollection_shard2_replica1] o.a.s.c.SolrCore [testcollection_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@1e31cfa0
[junit4] 2> 45947 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.c.Overseer Overseer (id=96856584588689417-127.0.0.1:64087_solr-n_0000000001) closing
[junit4] 2> 45950 INFO (OverseerStateUpdate-96856584588689417-127.0.0.1:64087_solr-n_0000000001) [n:127.0.0.1:64087_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:64087_solr
[junit4] 2> 45951 INFO (zkCallback-43-thread-1-processing-n:127.0.0.1:64168_solr) [n:127.0.0.1:64168_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/currentstate/state.json] for collection [currentstate] has occurred - updating... (live nodes size: [3])
[junit4] 2> 45951 WARN (zkCallback-43-thread-1-processing-n:127.0.0.1:64168_solr) [n:127.0.0.1:64168_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections/currentstate/state.json]
[junit4] 2> 45958 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@31d64ebb{/solr,null,UNAVAILABLE}
[junit4] 2> 45958 INFO (zkCallback-21-thread-2-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 47463 WARN (zkCallback-21-thread-2-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 47463 WARN (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 47463 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@36107174{/solr,null,UNAVAILABLE}
[junit4] 2> 47463 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5bb91f87{/solr,null,UNAVAILABLE}
[junit4] 2> 47469 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:64080 64080
[junit4] 2> 48576 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:64080 64080
[junit4] 2> 56881 WARN (Thread-1) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/config
[junit4] 2> 2 /solr/collections/stateformat1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 21 /solr/collections/falsepredicate/state.json
[junit4] 2> 12 /solr/collections/waitforstate/state.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/testcollection/state.json
[junit4] 2> 3 /solr/collections/currentstate/state.json
[junit4] 2> 2 /solr/collections/delayed/state.json
[junit4] 2> 2 /solr/collections/tobedeleted/state.json
[junit4] 2> 2 /solr/overseer_elect/election/96856584588689420-127.0.0.1:64088_solr-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 62 /solr/overseer/queue
[junit4] 2> 17 /solr/overseer/queue-work
[junit4] 2> 8 /solr/overseer/collection-queue-work
[junit4] 2> 7 /solr/collections
[junit4] 2> 5 /solr/live_nodes
[junit4] 2>
[junit4] 2> 56882 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001
[junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=th, timezone=America/Dawson
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_102 (32-bit)/cpus=3,threads=1,free=13283632,total=92532736
[junit4] 2> NOTE: All tests run in this JVM: [NamedListTest, SolrDocumentTest, TestCollectionStateWatchers]
[junit4] Completed [15/87 (1!)] on J0 in 57.64s, 9 tests, 1 failure <<< FAILURES!
[...truncated 59945 lines...]
Re: [JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk1.8.0) - Build # 3640 - Unstable!
Posted by Alan Woodward <al...@flax.co.uk>.
The timeout on this test was a lot lower than on all the others - have upped it to be consistent.
Alan Woodward
www.flax.co.uk
> On 31 Oct 2016, at 12:07, Policeman Jenkins Server <je...@thetaphi.de> wrote:
>
> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/3640/
> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC
>
> 1 tests failed.
> FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1
>
> Error Message:
> CollectionStateWatcher not notified of stateformat=1 collection creation
>
> Stack Trace:
> java.lang.AssertionError: CollectionStateWatcher not notified of stateformat=1 collection creation
> at __randomizedtesting.SeedInfo.seed([3E0FD36200A7DD4E:59C8CF8CF41FF9EF]:0)
> at org.junit.Assert.fail(Assert.java:93)
> at org.junit.Assert.assertTrue(Assert.java:43)
> at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1(TestCollectionStateWatchers.java:290)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> Build Log:
> [...truncated 13107 lines...]
> [junit4] Suite: org.apache.solr.common.cloud.TestCollectionStateWatchers
> [junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/init-core-data-001
> [junit4] 2> 0 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.e.j.u.log Logging initialized @9413ms
> [junit4] 2> 12 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
> [junit4] 2> 91 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001
> [junit4] 2> 123 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
> [junit4] 2> 132 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
> [junit4] 2> 132 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer Starting server
> [junit4] 2> 337 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:64080
> [junit4] 2> 603 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
> [junit4] 2> 4021 INFO (jetty-launcher-2-thread-3) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
> [junit4] 2> 4021 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
> [junit4] 2> 4021 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
> [junit4] 2> 4021 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
> [junit4] 2> 4199 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6bf64618{/solr,null,AVAILABLE}
> [junit4] 2> 4202 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4cba532{/solr,null,AVAILABLE}
> [junit4] 2> 4212 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5bb91f87{/solr,null,AVAILABLE}
> [junit4] 2> 4200 INFO (jetty-launcher-2-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36107174{/solr,null,AVAILABLE}
> [junit4] 2> 4273 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@49e4cb6c{HTTP/1.1,[http/1.1]}{127.0.0.1:64085}
> [junit4] 2> 4273 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.Server Started @13695ms
> [junit4] 2> 4273 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64085}
> [junit4] 2> 4276 INFO (jetty-launcher-2-thread-3) [ ] o.e.j.s.ServerConnector Started ServerConnector@6bfc906d{HTTP/1.1,[http/1.1]}{127.0.0.1:64087}
> [junit4] 2> 4281 INFO (jetty-launcher-2-thread-3) [ ] o.e.j.s.Server Started @13703ms
> [junit4] 2> 4277 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@4f5d38e6{HTTP/1.1,[http/1.1]}{127.0.0.1:64088}
> [junit4] 2> 4283 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.Server Started @13705ms
> [junit4] 2> 4277 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.ServerConnector Started ServerConnector@4aecdecf{HTTP/1.1,[http/1.1]}{127.0.0.1:64086}
> [junit4] 2> 4283 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.Server Started @13705ms
> [junit4] 2> 4283 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64088}
> [junit4] 2> 4283 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64086}
> [junit4] 2> 4281 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64087}
> [junit4] 2> 4358 ERROR (jetty-launcher-2-thread-4) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
> [junit4] 2> 4358 ERROR (jetty-launcher-2-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
> [junit4] 2> 4358 ERROR (jetty-launcher-2-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
> [junit4] 2> 4358 ERROR (jetty-launcher-2-thread-3) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
> [junit4] 2> 4364 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.0.0
> [junit4] 2> 4364 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.0.0
> [junit4] 2> 4366 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.0.0
> [junit4] 2> 4364 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.0.0
> [junit4] 2> 4376 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
> [junit4] 2> 4376 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
> [junit4] 2> 4376 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
> [junit4] 2> 4376 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
> [junit4] 2> 4376 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
> [junit4] 2> 4376 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
> [junit4] 2> 4378 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
> [junit4] 2> 4377 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
> [junit4] 2> 4486 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-31T11:43:17.602Z
> [junit4] 2> 4486 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-31T11:43:17.602Z
> [junit4] 2> 4486 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-31T11:43:17.602Z
> [junit4] 2> 4486 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-31T11:43:17.602Z
> [junit4] 2> 4802 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
> [junit4] 2> 4812 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
> [junit4] 2> 4825 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
> [junit4] 2> 4827 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
> [junit4] 2> 4833 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
> [junit4] 2> 7095 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64080/solr
> [junit4] 2> 7098 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64080/solr
> [junit4] 2> 7100 INFO (jetty-launcher-2-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64080/solr
> [junit4] 2> 7100 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:64080/solr
> [junit4] 2> 7508 INFO (jetty-launcher-2-thread-1) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:64085_solr
> [junit4] 2> 7521 INFO (jetty-launcher-2-thread-1) [n:127.0.0.1:64085_solr ] o.a.s.c.Overseer Overseer (id=96856584588689419-127.0.0.1:64085_solr-n_0000000000) starting
> [junit4] 2> 7529 INFO (jetty-launcher-2-thread-2) [n:127.0.0.1:64088_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64088_solr
> [junit4] 2> 7533 INFO (jetty-launcher-2-thread-3) [n:127.0.0.1:64087_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64087_solr
> [junit4] 2> 7547 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:64086_solr) [n:127.0.0.1:64086_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
> [junit4] 2> 7549 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
> [junit4] 2> 7547 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
> [junit4] 2> 7551 INFO (zkCallback-22-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
> [junit4] 2> 7645 INFO (jetty-launcher-2-thread-4) [n:127.0.0.1:64086_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64086_solr
> [junit4] 2> 7649 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
> [junit4] 2> 7649 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:64086_solr) [n:127.0.0.1:64086_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
> [junit4] 2> 7649 INFO (zkCallback-22-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
> [junit4] 2> 7649 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
> [junit4] 2> 8123 INFO (jetty-launcher-2-thread-3) [n:127.0.0.1:64087_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node3/.
> [junit4] 2> 8124 INFO (jetty-launcher-2-thread-2) [n:127.0.0.1:64088_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/.
> [junit4] 2> 8127 INFO (jetty-launcher-2-thread-4) [n:127.0.0.1:64086_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node4/.
> [junit4] 2> 8767 INFO (jetty-launcher-2-thread-1) [n:127.0.0.1:64085_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64085_solr
> [junit4] 2> 8776 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:64086_solr) [n:127.0.0.1:64086_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 8777 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 8778 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 8778 INFO (zkCallback-22-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
> [junit4] 2> 8897 INFO (jetty-launcher-2-thread-1) [n:127.0.0.1:64085_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node1/.
> [junit4] 2> 8985 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
> [junit4] 2> 9095 INFO (TEST-TestCollectionStateWatchers.testWatchesWorkForStateFormat1-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testWatchesWorkForStateFormat1
> [junit4] 2> 11262 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=33f0fcff-cf46-4514-84fe-3e23c57299ee&replicationFactor=1&collection.configName=config&name=stateformat1&action=CREATE&numShards=1&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 11303 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=33f0fcff-cf46-4514-84fe-3e23c57299ee&replicationFactor=1&collection.configName=config&name=stateformat1&action=CREATE&numShards=1&stateFormat=1&wt=javabin&version=2} status=0 QTime=543
> [junit4] 2> 11333 INFO (OverseerThreadFactory-24-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection stateformat1
> [junit4] 2> 11550 INFO (qtp1219989139-54) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&qt=/admin/cores&collection.configName=config&newCollection=true&name=stateformat1_shard1_replica1&action=CREATE&numShards=1&collection=stateformat1&shard=shard1&wt=javabin&version=2} status=0 QTime=16
> [junit4] 2> 11567 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation core create command async=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&qt=/admin/cores&collection.configName=config&newCollection=true&name=stateformat1_shard1_replica1&action=CREATE&numShards=1&collection=stateformat1&shard=shard1&wt=javabin&version=2
> [junit4] 2> 11669 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 11670 INFO (qtp1219989139-54) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 11671 INFO (qtp1219989139-54) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 11674 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
> [junit4] 2> 12683 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 12684 INFO (qtp1219989139-55) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 12685 INFO (qtp1219989139-55) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
> [junit4] 2> 12688 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=4
> [junit4] 2> 12809 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
> [junit4] 2> 13077 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema [stateformat1_shard1_replica1] Schema name=test
> [junit4] 2> 13697 INFO (qtp1219989139-56) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 13697 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 13697 INFO (qtp1219989139-56) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 13700 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
> [junit4] 2> 14708 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 14708 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 14708 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 14710 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
> [junit4] 2> 14994 WARN (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema [stateformat1_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
> [junit4] 2> 15005 WARN (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
> [junit4] 2> 15006 WARN (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
> [junit4] 2> 15009 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
> [junit4] 2> 15083 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 x:stateformat1_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'stateformat1_shard1_replica1' using configuration from collection stateformat1
> [junit4] 2> 15330 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SolrCore [[stateformat1_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/stateformat1_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/./stateformat1_shard1_replica1/data/]
> [junit4] 2> 15714 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 15714 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 15722 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 15725 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
> [junit4] 2> 16726 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 16726 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 16737 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 16740 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
> [junit4] 2> 17734 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 17734 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 17746 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 17768 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=22
> [junit4] 2> 18744 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 18744 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 18777 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 18780 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
> [junit4] 2> 19751 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 19752 INFO (qtp1219989139-58) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 19785 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 19791 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
> [junit4] 2> 19970 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
> [junit4] 2> 19970 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
> [junit4] 2> 20013 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 20013 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 20181 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@d4fba9b[stateformat1_shard1_replica1] main]
> [junit4] 2> 20256 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
> [junit4] 2> 20358 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
> [junit4] 2> 20533 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
> [junit4] 2> 20696 INFO (searcherExecutor-27-thread-1-processing-x:stateformat1_shard1_replica1 r:core_node1 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE n:127.0.0.1:64088_solr s:shard1 c:stateformat1) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SolrCore [stateformat1_shard1_replica1] Registered new searcher Searcher@d4fba9b[stateformat1_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> [junit4] 2> 20698 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1549705374770135040
> [junit4] 2> 20756 INFO (qtp1219989139-56) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 20756 INFO (qtp1219989139-56) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 20771 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
> [junit4] 2> 20771 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
> [junit4] 2> 20778 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64088/solr/stateformat1_shard1_replica1/
> [junit4] 2> 20785 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
> [junit4] 2> 20785 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:64088/solr/stateformat1_shard1_replica1/ has no replicas
> [junit4] 2> 20798 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 20802 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=4
> [junit4] 2> 20943 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64088/solr/stateformat1_shard1_replica1/ shard1
> [junit4] 2> 21082 INFO (parallelCoreAdminExecutor-19-thread-1-processing-n:127.0.0.1:64088_solr 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398 CREATE) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
> [junit4] 2> 21770 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398
> [junit4] 2> 21770 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee1003409041453398&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 21804 INFO (OverseerThreadFactory-24-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
> [junit4] 2> 21810 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 21824 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=14
> [junit4] 2> 21834 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 21840 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=33f0fcff-cf46-4514-84fe-3e23c57299ee&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=6
> [junit4] 2> 21844 INFO (TEST-TestCollectionStateWatchers.testWatchesWorkForStateFormat1-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testWatchesWorkForStateFormat1
> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestCollectionStateWatchers -Dtests.method=testWatchesWorkForStateFormat1 -Dtests.seed=3E0FD36200A7DD4E -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=America/Dawson -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
> [junit4] FAILURE 12.8s J0 | TestCollectionStateWatchers.testWatchesWorkForStateFormat1 <<<
> [junit4] > Throwable #1: java.lang.AssertionError: CollectionStateWatcher not notified of stateformat=1 collection creation
> [junit4] > at __randomizedtesting.SeedInfo.seed([3E0FD36200A7DD4E:59C8CF8CF41FF9EF]:0)
> [junit4] > at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1(TestCollectionStateWatchers.java:290)
> [junit4] > at java.lang.Thread.run(Thread.java:745)
> [junit4] 2> 21898 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeletionsTriggerWatches
> [junit4] 2> 21911 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=config&name=tobedeleted&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 21921 INFO (OverseerThreadFactory-24-thread-2-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection tobedeleted
> [junit4] 2> 21923 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
> [junit4] 2> 22152 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=config&newCollection=true&name=tobedeleted_shard1_replica1&action=CREATE&numShards=1&collection=tobedeleted&shard=shard1&wt=javabin&version=2
> [junit4] 2> 22272 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 23198 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
> [junit4] 2> 23298 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema [tobedeleted_shard1_replica1] Schema name=test
> [junit4] 2> 23513 WARN (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema [tobedeleted_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
> [junit4] 2> 23518 WARN (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
> [junit4] 2> 23519 WARN (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
> [junit4] 2> 23527 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
> [junit4] 2> 23531 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'tobedeleted_shard1_replica1' using configuration from collection tobedeleted
> [junit4] 2> 23534 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore [[tobedeleted_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/tobedeleted_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data/]
> [junit4] 2> 23573 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
> [junit4] 2> 23575 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
> [junit4] 2> 23581 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 23584 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 23586 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@64360116[tobedeleted_shard1_replica1] main]
> [junit4] 2> 23590 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
> [junit4] 2> 23593 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
> [junit4] 2> 23593 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
> [junit4] 2> 23594 INFO (searcherExecutor-32-thread-1-processing-n:127.0.0.1:64088_solr x:tobedeleted_shard1_replica1 s:shard1 c:tobedeleted r:core_node1) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore [tobedeleted_shard1_replica1] Registered new searcher Searcher@64360116[tobedeleted_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> [junit4] 2> 23595 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1549705377806811136
> [junit4] 2> 23616 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
> [junit4] 2> 23618 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
> [junit4] 2> 23618 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64088/solr/tobedeleted_shard1_replica1/
> [junit4] 2> 23619 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
> [junit4] 2> 23619 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:64088/solr/tobedeleted_shard1_replica1/ has no replicas
> [junit4] 2> 23630 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64088/solr/tobedeleted_shard1_replica1/ shard1
> [junit4] 2> 23743 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 23793 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
> [junit4] 2> 23801 INFO (qtp1219989139-57) [n:127.0.0.1:64088_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=config&newCollection=true&name=tobedeleted_shard1_replica1&action=CREATE&numShards=1&collection=tobedeleted&shard=shard1&wt=javabin&version=2} status=0 QTime=1649
> [junit4] 2> 23814 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
> [junit4] 2> 23919 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 23936 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000001 doesn't exist. Requestor may have disconnected from ZooKeeper
> [junit4] 2> 24822 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=config&name=tobedeleted&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2911
> [junit4] 2> 24829 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=tobedeleted&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 24842 INFO (OverseerThreadFactory-24-thread-3-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
> [junit4] 2> 24848 INFO (qtp1219989139-45) [n:127.0.0.1:64088_solr ] o.a.s.c.SolrCore [tobedeleted_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@75c1118d
> [junit4] 2> 24893 INFO (qtp1219989139-45) [n:127.0.0.1:64088_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=tobedeleted_shard1_replica1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=46
> [junit4] 2> 25029 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 25639 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=tobedeleted&action=DELETE&wt=javabin&version=2} status=0 QTime=810
> [junit4] 2> 25640 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDeletionsTriggerWatches
> [junit4] 2> 25686 INFO (TEST-TestCollectionStateWatchers.testPredicateFailureTimesOut-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testPredicateFailureTimesOut
> [junit4] 2> 26716 INFO (TEST-TestCollectionStateWatchers.testPredicateFailureTimesOut-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testPredicateFailureTimesOut
> [junit4] 2> 26753 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForStateChecksCurrentState
> [junit4] 2> 26768 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&replicationFactor=1&collection.configName=config&name=waitforstate&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 26772 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&replicationFactor=1&collection.configName=config&name=waitforstate&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=4
> [junit4] 2> 26775 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 26783 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=7
> [junit4] 2> 26791 INFO (OverseerThreadFactory-24-thread-4-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection waitforstate
> [junit4] 2> 26794 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000003 doesn't exist. Requestor may have disconnected from ZooKeeper
> [junit4] 2> 26938 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&qt=/admin/cores&collection.configName=config&newCollection=true&name=waitforstate_shard1_replica1&action=CREATE&numShards=1&collection=waitforstate&shard=shard1&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 26938 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CoreAdminOperation core create command async=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&qt=/admin/cores&collection.configName=config&newCollection=true&name=waitforstate_shard1_replica1&action=CREATE&numShards=1&collection=waitforstate&shard=shard1&wt=javabin&version=2
> [junit4] 2> 26941 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381
> [junit4] 2> 26942 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
> [junit4] 2> 27057 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/waitforstate/state.json] for collection [waitforstate] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 27792 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 27799 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
> [junit4] 2> 27950 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381
> [junit4] 2> 27950 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 27984 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
> [junit4] 2> 28044 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema [waitforstate_shard1_replica1] Schema name=test
> [junit4] 2> 28200 WARN (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema [waitforstate_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
> [junit4] 2> 28203 WARN (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
> [junit4] 2> 28204 WARN (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
> [junit4] 2> 28205 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
> [junit4] 2> 28212 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'waitforstate_shard1_replica1' using configuration from collection waitforstate
> [junit4] 2> 28213 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore [[waitforstate_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node3/waitforstate_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node3/./waitforstate_shard1_replica1/data/]
> [junit4] 2> 28255 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
> [junit4] 2> 28255 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
> [junit4] 2> 28260 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 28260 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 28261 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@16448e0e[waitforstate_shard1_replica1] main]
> [junit4] 2> 28264 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
> [junit4] 2> 28265 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
> [junit4] 2> 28265 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
> [junit4] 2> 28266 INFO (searcherExecutor-37-thread-1-processing-x:waitforstate_shard1_replica1 r:core_node1 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE n:127.0.0.1:64087_solr s:shard1 c:waitforstate) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore [waitforstate_shard1_replica1] Registered new searcher Searcher@16448e0e[waitforstate_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> [junit4] 2> 28266 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1549705382705758208
> [junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
> [junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
> [junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64087/solr/waitforstate_shard1_replica1/
> [junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
> [junit4] 2> 28287 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:64087/solr/waitforstate_shard1_replica1/ has no replicas
> [junit4] 2> 28303 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64087/solr/waitforstate_shard1_replica1/ shard1
> [junit4] 2> 28420 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/waitforstate/state.json] for collection [waitforstate] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 28464 INFO (parallelCoreAdminExecutor-20-thread-1-processing-n:127.0.0.1:64087_solr 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381 CREATE) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
> [junit4] 2> 28583 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/waitforstate/state.json] for collection [waitforstate] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 28803 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 28807 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
> [junit4] 2> 28955 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381
> [junit4] 2> 28956 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe1003424478328381&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 28965 INFO (OverseerThreadFactory-24-thread-4-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000005 doesn't exist. Requestor may have disconnected from ZooKeeper
> [junit4] 2> 29820 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 29823 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
> [junit4] 2> 29826 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 29827 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d8e16c-4b45-4b25-8deb-62adb1dd3cbe&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=1
> [junit4] 2> 29858 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testWaitForStateChecksCurrentState
> [junit4] 2> 29892 INFO (TEST-TestCollectionStateWatchers.testCanWaitForNonexistantCollection-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCanWaitForNonexistantCollection
> [junit4] 2> 29906 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&replicationFactor=1&collection.configName=config&name=delayed&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 29912 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&replicationFactor=1&collection.configName=config&name=delayed&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=6
> [junit4] 2> 29914 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 29921 INFO (qtp645998558-44) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=6
> [junit4] 2> 29923 INFO (OverseerThreadFactory-24-thread-5-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection delayed
> [junit4] 2> 29925 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000005 doesn't exist. Requestor may have disconnected from ZooKeeper
> [junit4] 2> 30046 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 30163 INFO (qtp207420342-49) [n:127.0.0.1:64085_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&qt=/admin/cores&collection.configName=config&newCollection=true&name=delayed_shard1_replica1&action=CREATE&numShards=1&collection=delayed&shard=shard1&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 30163 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr ] o.a.s.h.a.CoreAdminOperation core create command async=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&qt=/admin/cores&collection.configName=config&newCollection=true&name=delayed_shard1_replica1&action=CREATE&numShards=1&collection=delayed&shard=shard1&wt=javabin&version=2
> [junit4] 2> 30166 INFO (qtp207420342-50) [n:127.0.0.1:64085_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637
> [junit4] 2> 30167 INFO (qtp207420342-50) [n:127.0.0.1:64085_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
> [junit4] 2> 30288 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 30288 INFO (zkCallback-22-thread-1-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 30927 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 30930 INFO (qtp645998558-29) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
> [junit4] 2> 31172 INFO (qtp207420342-51) [n:127.0.0.1:64085_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637
> [junit4] 2> 31172 INFO (qtp207420342-51) [n:127.0.0.1:64085_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 31189 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
> [junit4] 2> 31228 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema [delayed_shard1_replica1] Schema name=test
> [junit4] 2> 31347 WARN (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema [delayed_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
> [junit4] 2> 31351 WARN (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
> [junit4] 2> 31351 WARN (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
> [junit4] 2> 31352 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
> [junit4] 2> 31354 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 x:delayed_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'delayed_shard1_replica1' using configuration from collection delayed
> [junit4] 2> 31355 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SolrCore [[delayed_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node1/delayed_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001/tempDir-001/node1/./delayed_shard1_replica1/data/]
> [junit4] 2> 31375 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
> [junit4] 2> 31375 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
> [junit4] 2> 31378 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
> [junit4] 2> 31378 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
> [junit4] 2> 31380 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@736a647b[delayed_shard1_replica1] main]
> [junit4] 2> 31383 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
> [junit4] 2> 31384 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
> [junit4] 2> 31384 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
> [junit4] 2> 31385 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1549705385976266752
> [junit4] 2> 31385 INFO (searcherExecutor-42-thread-1-processing-x:delayed_shard1_replica1 r:core_node1 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE n:127.0.0.1:64085_solr s:shard1 c:delayed) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SolrCore [delayed_shard1_replica1] Registered new searcher Searcher@736a647b[delayed_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
> [junit4] 2> 31401 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
> [junit4] 2> 31402 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
> [junit4] 2> 31402 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:64085/solr/delayed_shard1_replica1/
> [junit4] 2> 31402 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
> [junit4] 2> 31402 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:64085/solr/delayed_shard1_replica1/ has no replicas
> [junit4] 2> 31417 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:64085/solr/delayed_shard1_replica1/ shard1
> [junit4] 2> 31538 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 31538 INFO (zkCallback-22-thread-3-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 31595 INFO (parallelCoreAdminExecutor-25-thread-1-processing-n:127.0.0.1:64085_solr 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637 CREATE) [n:127.0.0.1:64085_solr c:delayed s:shard1 r:core_node1 x:delayed_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
> [junit4] 2> 31724 INFO (zkCallback-31-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 31724 INFO (zkCallback-22-thread-2-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delayed/state.json] for collection [delayed] has occurred - updating... (live nodes size: [4])
> [junit4] 2> 31959 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 31962 INFO (qtp645998558-31) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
> [junit4] 2> 32176 INFO (qtp207420342-52) [n:127.0.0.1:64085_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637
> [junit4] 2> 32177 INFO (qtp207420342-52) [n:127.0.0.1:64085_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f61003427701205637&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 32199 INFO (OverseerThreadFactory-24-thread-5-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
> [junit4] 2> 32970 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 32973 INFO (qtp645998558-32) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
> [junit4] 2> 32975 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 32976 INFO (qtp645998558-33) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=90b9c2c4-c48b-4cc5-b50a-e3e1536ae7f6&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=1
> [junit4] 2> 32977 INFO (TEST-TestCollectionStateWatchers.testCanWaitForNonexistantCollection-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCanWaitForNonexistantCollection
> [junit4] 2> 33014 INFO (TEST-TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister-seed#[3E0FD36200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testStateWatcherChecksCurrentStateOnRegister
> [junit4] 2> 33029 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=76d205a3-9443-40fb-8132-51a0c2a82578&replicationFactor=1&collection.configName=config&name=currentstate&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 33034 INFO (qtp645998558-34) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=76d205a3-9443-40fb-8132-51a0c2a82578&replicationFactor=1&collection.configName=config&name=currentstate&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=4
> [junit4] 2> 33039 INFO (OverseerThreadFactory-24-thread-5-processing-n:127.0.0.1:64085_solr) [n:127.0.0.1:64085_solr ] o.a.s.c.CreateCollectionCmd Create collection currentstate
> [junit4] 2> 33041 INFO (OverseerCollectionConfigSetProcessor-96856584588689419-127.0.0.1:64085_solr-n_0000000000) [n:127.0.0.1:64085_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
> [junit4] 2> 33043 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=76d205a3-9443-40fb-8132-51a0c2a82578&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
> [junit4] 2> 33049 INFO (qtp645998558-43) [n:127.0.0.1:64087_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=76d205a3-9443-40fb-8132-51a0c2a82578&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=5
> [junit4] 2> 33275 INFO (qtp270658667-37) [n:127.0.0.1:64086_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=76d205a3-9443-40fb-8132-51a0c2a825781003430813096675&qt=/admin/cores&collection.configName=config&newCollection=true&name=currentstate_shard1_replica1&action=CREATE&numShards=1&collection=currentstate&shard=shard1&wt=javabin&version=2} status=0 QTime=0
> [junit4] 2> 33275 INFO (parallelCoreAdminExecutor-18-thread-1-processing-n:127.0.0.1:64086_s
>
> [...truncated too long message...]
>
> 200A7DD4E]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSimpleCollectionWatch
> [junit4] 2> 45905 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@6bfc906d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
> [junit4] 2> 45905 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1838003778
> [junit4] 2> 45905 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@78f47f44{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
> [junit4] 2> 45905 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@4f5d38e6{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
> [junit4] 2> 45905 INFO (jetty-launcher-2-thread-4) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=449129643
> [junit4] 2> 45906 INFO (jetty-launcher-2-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=851899165
> [junit4] 2> 45909 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [3])
> [junit4] 2> 45909 INFO (zkCallback-43-thread-1-processing-n:127.0.0.1:64168_solr) [n:127.0.0.1:64168_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [3])
> [junit4] 2> 45909 INFO (zkCallback-21-thread-2-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [3])
> [junit4] 2> 45914 INFO (coreCloseExecutor-132-thread-1) [n:127.0.0.1:64168_solr c:falsepredicate s:shard3 r:core_node1 x:falsepredicate_shard3_replica1] o.a.s.c.SolrCore [falsepredicate_shard3_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@4d4500e
> [junit4] 2> 45915 INFO (coreCloseExecutor-132-thread-2) [n:127.0.0.1:64168_solr c:currentstate s:shard1 r:core_node1 x:currentstate_shard1_replica1] o.a.s.c.SolrCore [currentstate_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@6f044d63
> [junit4] 2> 45917 INFO (coreCloseExecutor-134-thread-1) [n:127.0.0.1:64087_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore [waitforstate_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@18e1ebb
> [junit4] 2> 45917 INFO (coreCloseExecutor-134-thread-2) [n:127.0.0.1:64087_solr c:falsepredicate s:shard4 r:core_node4 x:falsepredicate_shard4_replica1] o.a.s.c.SolrCore [falsepredicate_shard4_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@17a9debb
> [junit4] 2> 45919 INFO (coreCloseExecutor-133-thread-1) [n:127.0.0.1:64088_solr c:stateformat1 s:shard1 r:core_node1 x:stateformat1_shard1_replica1] o.a.s.c.SolrCore [stateformat1_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@32481761
> [junit4] 2> 45919 INFO (coreCloseExecutor-133-thread-2) [n:127.0.0.1:64088_solr c:falsepredicate s:shard2 r:core_node3 x:falsepredicate_shard2_replica1] o.a.s.c.SolrCore [falsepredicate_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@29806b8b
> [junit4] 2> 45922 INFO (coreCloseExecutor-132-thread-3) [n:127.0.0.1:64168_solr c:testcollection s:shard4 r:core_node3 x:testcollection_shard4_replica1] o.a.s.c.SolrCore [testcollection_shard4_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@3ea98e65
> [junit4] 2> 45923 INFO (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [3])
> [junit4] 2> 45924 INFO (zkCallback-43-thread-1-processing-n:127.0.0.1:64168_solr) [n:127.0.0.1:64168_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [3])
> [junit4] 2> 45924 INFO (zkCallback-21-thread-2-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [3])
> [junit4] 2> 45924 INFO (coreCloseExecutor-134-thread-3) [n:127.0.0.1:64087_solr c:testcollection s:shard3 r:core_node2 x:testcollection_shard3_replica1] o.a.s.c.SolrCore [testcollection_shard3_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@337bce17
> [junit4] 2> 45924 INFO (coreCloseExecutor-133-thread-3) [n:127.0.0.1:64088_solr c:testcollection s:shard2 r:core_node1 x:testcollection_shard2_replica1] o.a.s.c.SolrCore [testcollection_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@1e31cfa0
> [junit4] 2> 45947 INFO (jetty-launcher-2-thread-1) [ ] o.a.s.c.Overseer Overseer (id=96856584588689417-127.0.0.1:64087_solr-n_0000000001) closing
> [junit4] 2> 45950 INFO (OverseerStateUpdate-96856584588689417-127.0.0.1:64087_solr-n_0000000001) [n:127.0.0.1:64087_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:64087_solr
> [junit4] 2> 45951 INFO (zkCallback-43-thread-1-processing-n:127.0.0.1:64168_solr) [n:127.0.0.1:64168_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/currentstate/state.json] for collection [currentstate] has occurred - updating... (live nodes size: [3])
> [junit4] 2> 45951 WARN (zkCallback-43-thread-1-processing-n:127.0.0.1:64168_solr) [n:127.0.0.1:64168_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections/currentstate/state.json]
> [junit4] 2> 45958 INFO (jetty-launcher-2-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@31d64ebb{/solr,null,UNAVAILABLE}
> [junit4] 2> 45958 INFO (zkCallback-21-thread-2-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
> [junit4] 2> 47463 WARN (zkCallback-21-thread-2-processing-n:127.0.0.1:64087_solr) [n:127.0.0.1:64087_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
> [junit4] 2> 47463 WARN (zkCallback-23-thread-1-processing-n:127.0.0.1:64088_solr) [n:127.0.0.1:64088_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
> [junit4] 2> 47463 INFO (jetty-launcher-2-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@36107174{/solr,null,UNAVAILABLE}
> [junit4] 2> 47463 INFO (jetty-launcher-2-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5bb91f87{/solr,null,UNAVAILABLE}
> [junit4] 2> 47469 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:64080 64080
> [junit4] 2> 48576 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:64080 64080
> [junit4] 2> 56881 WARN (Thread-1) [ ] o.a.s.c.ZkTestServer Watch limit violations:
> [junit4] 2> Maximum concurrent create/delete watches above limit:
> [junit4] 2>
> [junit4] 2> 7 /solr/aliases.json
> [junit4] 2> 7 /solr/clusterprops.json
> [junit4] 2> 6 /solr/security.json
> [junit4] 2> 6 /solr/configs/config
> [junit4] 2> 2 /solr/collections/stateformat1/state.json
> [junit4] 2>
> [junit4] 2> Maximum concurrent data watches above limit:
> [junit4] 2>
> [junit4] 2> 21 /solr/collections/falsepredicate/state.json
> [junit4] 2> 12 /solr/collections/waitforstate/state.json
> [junit4] 2> 7 /solr/clusterstate.json
> [junit4] 2> 6 /solr/collections/testcollection/state.json
> [junit4] 2> 3 /solr/collections/currentstate/state.json
> [junit4] 2> 2 /solr/collections/delayed/state.json
> [junit4] 2> 2 /solr/collections/tobedeleted/state.json
> [junit4] 2> 2 /solr/overseer_elect/election/96856584588689420-127.0.0.1:64088_solr-n_0000000002
> [junit4] 2>
> [junit4] 2> Maximum concurrent children watches above limit:
> [junit4] 2>
> [junit4] 2> 62 /solr/overseer/queue
> [junit4] 2> 17 /solr/overseer/queue-work
> [junit4] 2> 8 /solr/overseer/collection-queue-work
> [junit4] 2> 7 /solr/collections
> [junit4] 2> 5 /solr/live_nodes
> [junit4] 2>
> [junit4] 2> 56882 INFO (SUITE-TestCollectionStateWatchers-seed#[3E0FD36200A7DD4E]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
> [junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.common.cloud.TestCollectionStateWatchers_3E0FD36200A7DD4E-001
> [junit4] 2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=th, timezone=America/Dawson
> [junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_102 (32-bit)/cpus=3,threads=1,free=13283632,total=92532736
> [junit4] 2> NOTE: All tests run in this JVM: [NamedListTest, SolrDocumentTest, TestCollectionStateWatchers]
> [junit4] Completed [15/87 (1!)] on J0 in 57.64s, 9 tests, 1 failure <<< FAILURES!
>
> [...truncated 59945 lines...]
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org