You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/07/20 16:02:13 UTC
[JENKINS] Lucene-Solr-Tests-6.x - Build # 340 - Unstable
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/340/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestRequestForwarding
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestRequestForwarding: 1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=5493, name=OverseerStateUpdate-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer state updater.] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:138) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:196) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestRequestForwarding:
1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=5493, name=OverseerStateUpdate-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer state updater.]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:138)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:196)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([EBCB947803CDF279]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestRequestForwarding
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([EBCB947803CDF279]:0)
Build Log:
[...truncated 11279 lines...]
[junit4] Suite: org.apache.solr.cloud.TestRequestForwarding
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/init-core-data-001
[junit4] 2> 652320 INFO (SUITE-TestRequestForwarding-seed#[EBCB947803CDF279]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
[junit4] 2> 652322 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMultiCollectionQuery
[junit4] 2> 652323 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 652323 INFO (Thread-1359) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 652323 INFO (Thread-1359) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 652423 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.ZkTestServer start zk server on port:58149
[junit4] 2> 652423 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652424 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652426 INFO (zkCallback-820-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3fb2568 name:ZooKeeperConnection Watcher:127.0.0.1:58149 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652426 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652426 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652426 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 652430 INFO (jetty-launcher-819-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 652433 INFO (jetty-launcher-819-thread-2) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 652438 INFO (jetty-launcher-819-thread-3) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 652448 INFO (jetty-launcher-819-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@62a2deca{/solr,null,AVAILABLE}
[junit4] 2> 652450 INFO (jetty-launcher-819-thread-3) [ ] o.e.j.s.ServerConnector Started ServerConnector@69e25b7{HTTP/1.1,[http/1.1]}{127.0.0.1:52298}
[junit4] 2> 652450 INFO (jetty-launcher-819-thread-3) [ ] o.e.j.s.Server Started @657182ms
[junit4] 2> 652450 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52298}
[junit4] 2> 652450 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
[junit4] 2> 652450 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node3'
[junit4] 2> 652450 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 652450 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 652451 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652451 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652452 INFO (jetty-launcher-819-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e3f9e75{/solr,null,AVAILABLE}
[junit4] 2> 652452 INFO (jetty-launcher-819-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@41d022d0{HTTP/1.1,[http/1.1]}{127.0.0.1:58236}
[junit4] 2> 652452 INFO (jetty-launcher-819-thread-1) [ ] o.e.j.s.Server Started @657184ms
[junit4] 2> 652452 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58236}
[junit4] 2> 652458 INFO (jetty-launcher-819-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29ba1c52{/solr,null,AVAILABLE}
[junit4] 2> 652458 INFO (jetty-launcher-819-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@3812c926{HTTP/1.1,[http/1.1]}{127.0.0.1:59539}
[junit4] 2> 652458 INFO (jetty-launcher-819-thread-2) [ ] o.e.j.s.Server Started @657190ms
[junit4] 2> 652458 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59539}
[junit4] 2> 652459 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
[junit4] 2> 652459 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node2'
[junit4] 2> 652459 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 652459 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 652459 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652459 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652460 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
[junit4] 2> 652460 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node1'
[junit4] 2> 652460 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 652460 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 652460 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652461 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652468 INFO (zkCallback-822-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e45dc7f name:ZooKeeperConnection Watcher:127.0.0.1:58149/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652473 INFO (zkCallback-823-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@764de959 name:ZooKeeperConnection Watcher:127.0.0.1:58149/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652473 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652473 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652474 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 652474 INFO (zkCallback-821-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1474c623 name:ZooKeeperConnection Watcher:127.0.0.1:58149/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652474 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652474 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652475 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 652478 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652478 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652479 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node1/.
[junit4] 2> 652479 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 2124413704
[junit4] 2> 652479 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 652479 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node1]
[junit4] 2> 652480 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node3/.
[junit4] 2> 652480 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.CoreContainer New CoreContainer 1616568729
[junit4] 2> 652480 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node3]
[junit4] 2> 652480 WARN (jetty-launcher-819-thread-3) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node3/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node3/lib
[junit4] 2> 652480 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
[junit4] 2> 652484 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 652487 WARN (jetty-launcher-819-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node1/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node1/lib
[junit4] 2> 652487 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
[junit4] 2> 652493 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 652493 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 652496 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58149/solr
[junit4] 2> 652496 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 652496 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652498 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 652500 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node2/.
[junit4] 2> 652502 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.CoreContainer New CoreContainer 1977844186
[junit4] 2> 652502 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node2]
[junit4] 2> 652503 WARN (jetty-launcher-819-thread-2) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node2/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node2/lib
[junit4] 2> 652503 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
[junit4] 2> 652500 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652504 INFO (zkCallback-826-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5258fbe name:ZooKeeperConnection Watcher:127.0.0.1:58149 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652504 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652504 INFO (jetty-launcher-819-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652505 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 652505 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 652505 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 652506 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58149/solr
[junit4] 2> 652506 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 652506 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652507 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652507 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 652509 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 652509 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58149/solr
[junit4] 2> 652509 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 652509 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$37/2071218579@2db32839
[junit4] 2> 652509 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652511 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652512 INFO (zkCallback-831-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@9e08931 name:ZooKeeperConnection Watcher:127.0.0.1:58149 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652512 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652512 INFO (jetty-launcher-819-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652516 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652516 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$37/2071218579@16931d06
[junit4] 2> 652520 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652520 INFO (zkCallback-832-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@621fdaa6 name:ZooKeeperConnection Watcher:127.0.0.1:58149 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652521 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652521 INFO (zkCallback-833-thread-1-processing-n:127.0.0.1:52298_solr) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@32f88f5c name:ZooKeeperConnection Watcher:127.0.0.1:58149/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652521 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652521 INFO (jetty-launcher-819-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652521 INFO (zkCallback-834-thread-1-processing-n:127.0.0.1:59539_solr) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f93cc08 name:ZooKeeperConnection Watcher:127.0.0.1:58149/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652521 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652522 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$37/2071218579@975c919
[junit4] 2> 652522 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 652522 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 652523 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652523 INFO (zkCallback-835-thread-1-processing-n:127.0.0.1:58236_solr) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7cde7489 name:ZooKeeperConnection Watcher:127.0.0.1:58149/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652524 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652526 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 652526 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 652526 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 652531 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 652531 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 652531 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 652534 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 652534 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 652534 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 652537 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 652537 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 652537 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 652539 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 652539 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 652539 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 652541 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 652541 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 652541 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 652543 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 652543 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 652543 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 652545 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 652545 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 652545 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 652546 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 652546 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 652547 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 652547 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 652547 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 652548 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 652548 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 652549 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 652549 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 652549 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 652549 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 652553 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 652554 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 652554 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 652556 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 652556 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 652556 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 652557 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 652558 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 652558 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 652558 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96274232463130630-127.0.0.1:52298_solr-n_0000000001
[junit4] 2> 652558 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96274232463130632-127.0.0.1:59539_solr-n_0000000000
[junit4] 2> 652559 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96274232463130633-127.0.0.1:58236_solr-n_0000000002
[junit4] 2> 652559 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96274232463130632-127.0.0.1:59539_solr-n_0000000000 to know if I could be the leader
[junit4] 2> 652559 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59539_solr
[junit4] 2> 652559 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 652560 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52298_solr
[junit4] 2> 652560 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:52298_solr
[junit4] 2> 652560 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96274232463130630-127.0.0.1:52298_solr-n_0000000001 to know if I could be the leader
[junit4] 2> 652561 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58236_solr
[junit4] 2> 652561 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58236_solr
[junit4] 2> 652562 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.Overseer Overseer (id=96274232463130632-127.0.0.1:59539_solr-n_0000000000) starting
[junit4] 2> 652562 INFO (zkCallback-833-thread-1-processing-n:127.0.0.1:52298_solr) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 652562 INFO (zkCallback-834-thread-1-processing-n:127.0.0.1:59539_solr) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 652564 INFO (zkCallback-834-thread-1-processing-n:127.0.0.1:59539_solr) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 652566 INFO (zkCallback-833-thread-1-processing-n:127.0.0.1:52298_solr) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 652566 INFO (zkCallback-835-thread-1-processing-n:127.0.0.1:58236_solr) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 652568 INFO (zkCallback-834-thread-1-processing-n:127.0.0.1:59539_solr) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 652574 INFO (zkCallback-834-thread-1-processing-n:127.0.0.1:59539_solr) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 652577 INFO (zkCallback-835-thread-1-processing-n:127.0.0.1:58236_solr) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 652577 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 652578 INFO (zkCallback-833-thread-1-processing-n:127.0.0.1:52298_solr) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 652578 INFO (zkCallback-833-thread-1-processing-n:127.0.0.1:52298_solr) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 652582 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 652605 INFO (OverseerCollectionConfigSetProcessor-96274232463130632-127.0.0.1:59539_solr-n_0000000000) [n:127.0.0.1:59539_solr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 652606 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 652606 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 652607 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node3/.
[junit4] 2> 652607 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 652610 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 652610 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 652610 INFO (OverseerStateUpdate-96274232463130632-127.0.0.1:59539_solr-n_0000000000) [n:127.0.0.1:59539_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 652610 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:59539_solr as DOWN
[junit4] 2> 652611 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node1/.
[junit4] 2> 652611 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 652612 INFO (OverseerStateUpdate-96274232463130632-127.0.0.1:59539_solr-n_0000000000) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (2)
[junit4] 2> 652612 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 652612 INFO (jetty-launcher-819-thread-3) [n:127.0.0.1:52298_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 652613 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59539_solr
[junit4] 2> 652613 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 652613 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:59539_solr
[junit4] 2> 652613 INFO (jetty-launcher-819-thread-1) [n:127.0.0.1:58236_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 652614 INFO (OverseerStateUpdate-96274232463130632-127.0.0.1:59539_solr-n_0000000000) [n:127.0.0.1:59539_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:59539_solr"} current state version: 0
[junit4] 2> 652614 INFO (OverseerStateUpdate-96274232463130632-127.0.0.1:59539_solr-n_0000000000) [n:127.0.0.1:59539_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:59539_solr
[junit4] 2> 652614 INFO (zkCallback-835-thread-1-processing-n:127.0.0.1:58236_solr) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 652614 INFO (zkCallback-833-thread-1-processing-n:127.0.0.1:52298_solr) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 652615 INFO (zkCallback-833-thread-1-processing-n:127.0.0.1:52298_solr) [n:127.0.0.1:52298_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 652615 INFO (zkCallback-835-thread-1-processing-n:127.0.0.1:58236_solr) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 652615 INFO (zkCallback-834-thread-1-processing-n:127.0.0.1:59539_solr) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 652616 INFO (zkCallback-834-thread-1-processing-n:127.0.0.1:59539_solr) [n:127.0.0.1:59539_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 652623 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 652623 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 652624 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestRequestForwarding_EBCB947803CDF279-001/tempDir-001/node2/.
[junit4] 2> 652624 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 652625 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 652625 INFO (jetty-launcher-819-thread-2) [n:127.0.0.1:59539_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 652625 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652626 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652627 INFO (zkCallback-839-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5e31381f name:ZooKeeperConnection Watcher:127.0.0.1:58149 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652627 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652627 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652629 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 652629 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 652630 INFO (zkCallback-841-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7bbaadfe name:ZooKeeperConnection Watcher:127.0.0.1:58149/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 652630 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 652630 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 652631 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spellcheckcomponent.xml
[junit4] 2> 652633 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-null-charfilters-analyzer.xml
[junit4] 2> 652634 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/regex-boost-processor-test.txt
[junit4] 2> 652635 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spellchecker.xml
[junit4] 2> 652637 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-multiple-asterisk-copyfield-dest-should-fail-test.xml
[junit4] 2> 652638 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesFaceting.xml
[junit4] 2> 652639 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tlog-with-delayingcomponent.xml
[junit4] 2> 652641 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-bogus-default-code.xml
[junit4] 2> 652642 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-numeric.xml
[junit4] 2> 652643 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig_codec.xml
[junit4] 2> 652645 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-multiple-asterisk-copyfield-source-should-fail-test.xml
[junit4] 2> 652646 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema_latest.xml
[junit4] 2> 652647 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sorts.xml
[junit4] 2> 652648 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-headers.xml
[junit4] 2> 652650 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-implicitproperties.xml
[junit4] 2> 652651 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-bogus-scriptengine-name.xml
[junit4] 2> 652652 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-types.incl
[junit4] 2> 652653 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-parsing-update-processor-chains.xml
[junit4] 2> 652654 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesMissing.xml
[junit4] 2> 652655 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-noopregen.xml
[junit4] 2> 652657 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-one-field-no-dynamic-field-unique-key.xml
[junit4] 2> 652658 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-script-updateprocessor.xml
[junit4] 2> 652659 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-error-solrconfig.xml
[junit4] 2> 652660 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-suggestercomponent.xml
[junit4] 2> 652661 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-currency.xml
[junit4] 2> 652662 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-query-parser-init.xml
[junit4] 2> 652663 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-caching.xml
[junit4] 2> 652664 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/conditional.updateprocessor.js
[junit4] 2> 652666 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-indexconfig-mergepolicyfactory.xml
[junit4] 2> 652667 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/compoundDictionary.txt
[junit4] 2> 652668 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tieredmergepolicyfactory.xml
[junit4] 2> 652669 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/phrasesuggest.txt
[junit4] 2> 652670 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-transformers.xml
[junit4] 2> 652671 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-norms.xml
[junit4] 2> 652672 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/blendedInfixSuggest.txt
[junit4] 2> 652673 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-phrasesuggest.xml
[junit4] 2> 652674 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hunspell-test.dic
[junit4] 2> 652676 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-HighlighterMaxOffsetTest.xml
[junit4] 2> 652677 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-rest-lucene-match-version.xml
[junit4] 2> 652678 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-functionquery.xml
[junit4] 2> 652679 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-externalversionconstraint.xml
[junit4] 2> 652680 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-codec-global-vs-ft-mismatch.xml
[junit4] 2> 652681 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sim.xml
[junit4] 2> 652682 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesMulti.xml
[junit4] 2> 652684 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-logmergepolicyfactory.xml
[junit4] 2> 652685 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-collapseqparser.xml
[junit4] 2> 652686 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-analytics-query.xml
[junit4] 2> 652687 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sweetspot.xml
[junit4] 2> 652688 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-searcher-listeners1.xml
[junit4] 2> 652689 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-id-and-version-fields-only.xml
[junit4] 2> 652690 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-classification.xml
[junit4] 2> 652692 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-schema-mutable-but-not-managed.xml
[junit4] 2> 652693 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hunspell-test.aff
[junit4] 2> 652694 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-response-log-component.xml
[junit4] 2> 652696 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-default-does-not-exist.xml
[junit4] 2> 652697 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dynamicfield-required.xml
[junit4] 2> 652698 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-pos.xml
[junit4] 2> 652700 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-hash.xml
[junit4] 2> 652701 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-components-name.xml
[junit4] 2> 652702 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-mp-solrconfig.xml
[junit4] 2> 652704 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 652705 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-xinclude.xml
[junit4] 2> 652706 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/cross-compatible.js
[junit4] 2> 652708 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig_perf.xml
[junit4] 2> 652709 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-invalid-scriptfile.xml
[junit4] 2> 652710 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-basic.xml
[junit4] 2> 652712 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-sql.xml
[junit4] 2> 652713 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-replication1.xml
[junit4] 2> 652714 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-missing-scriptfile.xml
[junit4] 2> 652715 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-altdirectory.xml
[junit4] 2> 652716 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-distributed-missing-sort.xml
[junit4] 2> 652717 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 652718 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-sortingmergepolicyfactory.xml
[junit4] 2> 652719 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-tfidf.xml
[junit4] 2> 652721 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/jasuggest.txt
[junit4] 2> 652722 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-field.xml
[junit4] 2> 652723 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-cdcrupdatelog.xml
[junit4] 2> 652725 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/fuzzysuggest.txt
[junit4] 2> 652726 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-minimal.xml
[junit4] 2> 652727 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-highlight.xml
[junit4] 2> 652728 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tieredmergepolicy.xml
[junit4] 2> 652730 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-blockjoinfacetcomponent.xml
[junit4] 2> 652732 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-version-indexed.xml
[junit4] 2> 652733 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-unsupported-docValues.xml
[junit4] 2> 652735 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 652736 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-lmdirichlet.xml
[junit4] 2> 652745 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-synonym-tokenizer.xml
[junit4] 2> 652748 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stop-2.txt
[junit4] 2> 652749 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-non-stored-docvalues.xml
[junit4] 2> 652750 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sim-default-override.xml
[junit4] 2> 652751 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-plugcollector.xml
[junit4] 2> 652753 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-managed-schema-test.xml
[junit4] 2> 652754 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-uses-default.xml
[junit4] 2> 652755 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-global-vs-ft-mismatch.xml
[junit4] 2> 652756 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-warmer.xml
[junit4] 2> 652758 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema11.xml
[junit4] 2> 652759 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tlog.xml
[junit4] 2> 652761 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-withgethandler.xml
[junit4] 2> 652762 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-lmjelinekmercer.xml
[junit4] 2> 652764 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema12.xml
[junit4] 2> 652765 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-SOLR-749.xml
[junit4] 2> 652766 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-hyperbolic.xml
[junit4] 2> 652767 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master2.xml
[junit4] 2> 652769 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-bm25.xml
[junit4] 2> 652770 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 652771 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-preanalyzed.xml
[junit4] 2> 652772 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-type.xml
[junit4] 2> 652773 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-suggestercomponent-context-filter-query.xml
[junit4] 2> 652774 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-distrib-interval-faceting.xml
[junit4] 2> 652775 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master1.xml
[junit4] 2> 652777 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-oer-norates.xml
[junit4] 2> 652778 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-schemaless.xml
[junit4] 2> 652779 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dynamicfield-default-val.xml
[junit4] 2> 652780 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-norms.xml
[junit4] 2> 652781 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/elevate.xml
[junit4] 2> 652782 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-required-fields.xml
[junit4] 2> 652783 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-doc-expire-update-processor.xml
[junit4] 2> 652785 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-charfilters.xml
[junit4] 2> 652786 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-querysender.xml
[junit4] 2> 652787 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-nontext-analyzer.xml
[junit4] 2> 652788 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/frenchArticles.txt
[junit4] 2> 652789 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tolerant-search.xml
[junit4] 2> 652790 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-default-has-no-explicit-sim.xml
[junit4] 2> 652791 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 652793 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-update-processor-chains.xml
[junit4] 2> 652794 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-rest.xml
[junit4] 2> 652795 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/trivial.updateprocessor0.js
[junit4] 2> 652796 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-mergepolicy-nocfs.xml
[junit4] 2> 652798 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-reqHandler.incl
[junit4] 2> 652799 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 652800 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-spellchecker.xml
[junit4] 2> 652801 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-doctransformers.xml
[junit4] 2> 652802 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-reversed.xml
[junit4] 2> 652803 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-managed-schema.xml
[junit4] 2> 652804 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-omit-tf-but-not-pos.xml
[junit4] 2> 652806 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-solcoreproperties.xml
[junit4] 2> 652807 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 652808 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/keep-1.txt
[junit4] 2> 652809 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/throw.error.on.add.updateprocessor.js
[junit4] 2> 652810 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master-throttled.xml
[junit4] 2> 652811 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-distrib-update-processor-chains.xml
[junit4] 2> 652813 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-single-dynamic-copy-field.xml
[junit4] 2> 652814 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-xinclude.xml
[junit4] 2> 652815 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-elevate.xml
[junit4] 2> 652816 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stoptypes-2.txt
[junit4] 2> 652818 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-complex-phrase.xml
[junit4] 2> 652819 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master1-keepOneBackup.xml
[junit4] 2> 652820 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-bogus-analysis-parameters.xml
[junit4] 2> 652821 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stemdict.txt
[junit4] 2> 652822 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-trie.xml
[junit4] 2> 652823 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/wdftypes.txt
[junit4] 2> 652824 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-slave1.xml
[junit4] 2> 652826 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-defaults.xml
[junit4] 2> 652827 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-graph.xml
[junit4] 2> 652828 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-external-filefield.xml
[junit4] 2> 652829 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValues.xml
[junit4] 2> 652830 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delpolicy2.xml
[junit4] 2> 652831 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schemasurround.xml
[junit4] 2> 652833 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-test-misc.xml
[junit4] 2> 652834 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema15.xml
[junit4] 2> 652835 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-class-name-shortening-on-serialization.xml
[junit4] 2> 652836 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-add-schema-fields-update-processor.xml
[junit4] 2> 652837 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-collate.xml
[junit4] 2> 652839 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 652840 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-field.xml
[junit4] 2> 652841 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-indexconfig.xml
[junit4] 2> 652842 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad_solrconfig.xml
[junit4] 2> 652843 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-eff.xml
[junit4] 2> 652845 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-multivalued.xml
[junit4] 2> 652846 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-nrtmode.xml
[junit4] 2> 652847 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/analyzingInfixSuggest.txt
[junit4] 2> 652848 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-repeater.xml
[junit4] 2> 652850 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-spatial.xml
[junit4] 2> 652851 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-hash.xml
[junit4] 2> 652852 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spatial.xml
[junit4] 2> 652853 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-field-sort-values.xml
[junit4] 2> 652855 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stoptypes-1.txt
[junit4] 2> 652856 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-init-error.xml
[junit4] 2> 652857 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-customfield.xml
[junit4] 2> 652858 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-managed-schema-named-schema.xml.xml
[junit4] 2> 652859 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-paramset.xml
[junit4] 2> 652860 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-dynamicField.xml
[junit4] 2> 652861 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 652863 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-folding.xml
[junit4] 2> 652864 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-classification.xml
[junit4] 2> 652865 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwithbom.txt
[junit4] 2> 652866 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/missleading.extension.updateprocessor.js.txt
[junit4] 2> 652867 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-dynamic-multivalued.xml
[junit4] 2> 652868 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-binaryfield.xml
[junit4] 2> 652869 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-slave.xml
[junit4] 2> 652871 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-luceneMatchVersion.xml
[junit4] 2> 652872 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-cdcr.xml
[junit4] 2> 652873 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sortingresponse.xml
[junit4] 2> 652874 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-baseline.xml
[junit4] 2> 652875 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-stop-keep.xml
[junit4] 2> 652877 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-infostream-logging.xml
[junit4] 2> 652878 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-is-copyfield-dest.xml
[junit4] 2> 652879 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master.xml
[junit4] 2> 652880 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-replication2.xml
[junit4] 2> 652881 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-bogus-code-in-xml.xml
[junit4] 2> 652882 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/addfields.updateprocessor.js
[junit4] 2> 652883 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-dfr.xml
[junit4] 2> 652885 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-enums.xml
[junit4] 2> 652886 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delpolicy1.xml
[junit4] 2> 652887 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-minimal.xml
[junit4] 2> 652888 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-multiple-cfs.xml
[junit4] 2> 652889 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/trivial.updateprocessor1.js
[junit4] 2> 652890 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/missing.functions.updateprocessor.js
[junit4] 2> 652891 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-multiple-dirfactory.xml
[junit4] 2> 652892 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 652894 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-misplaced-asterisk-copyfield-source-should-fail-test.xml
[junit4] 2> 652895 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-add-schema-fields-update-processor-chains.xml
[junit4] 2> 652896 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-version-dv.xml
[junit4] 2> 652897 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delaying-component.xml
[junit4] 2> 652898 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-custom-field.xml
[junit4] 2> 652900 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-ib.xml
[junit4] 2> 652901 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/keep-2.txt
[junit4] 2> 652902 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-one-field-no-dynamic-field.xml
[junit4] 2> 652903 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-not-required-unique-key.xml
[junit4] 2> 652904 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tolerant-update-minimal.xml
[junit4] 2> 652906 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-minimal-atomic-stress.xml
[junit4] 2> 652907 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hyphenation.dtd
[junit4] 2> 652908 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sql.xml
[junit4] 2> 652909 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-copyfield-test.xml
[junit4] 2> 652911 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-analyzer-class-and-nested.xml
[junit4] 2> 652912 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-mpf-solrconfig.xml
[junit4] 2> 652913 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-multivalued.xml
[junit4] 2> 652914 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-querysender-noquery.xml
[junit4] 2> 652915 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-phrasesuggest.xml
[junit4] 2> 652917 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwordsWrongEncoding.txt
[junit4] 2> 652918 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-simpleqpplugin.xml
[junit4] 2> 652920 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279])
[...truncated too long message...]
835-thread-1-processing-n:127.0.0.1:58236_solr) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader Updating data for [collection1] from [6] to [7]
[junit4] 2> 656541 INFO (zkCallback-835-thread-2-processing-n:127.0.0.1:58236_solr) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 656541 WARN (zkCallback-835-thread-2-processing-n:127.0.0.1:58236_solr) [n:127.0.0.1:58236_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 656542 INFO (jetty-launcher-819-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6e3f9e75{/solr,null,UNAVAILABLE}
[junit4] 2> 656545 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58149 58149
[junit4] 2> 656644 INFO (Thread-1359) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58149 58149
[junit4] 2> 656644 WARN (Thread-1359) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 2 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 2 /solr/collections/collection1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/overseer/queue
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 656644 INFO (TEST-TestRequestForwarding.testMultiCollectionQuery-seed#[EBCB947803CDF279]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMultiCollectionQuery
[junit4] 2> 656645 INFO (SUITE-TestRequestForwarding-seed#[EBCB947803CDF279]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jul 20, 2016 3:23:29 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 4 leaked thread(s).
[junit4] 2> 658526 WARN (OverseerCollectionConfigSetProcessor-96274232463130633-127.0.0.1:58236_solr-n_0000000002) [n:127.0.0.1:58236_solr ] o.a.s.c.OverseerTaskProcessor Overseer cannot talk to ZK
[junit4] 2> Jul 20, 2016 3:23:49 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestRequestForwarding:
[junit4] 2> 1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2) Thread[id=5493, name=OverseerStateUpdate-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:138)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:196)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Jul 20, 2016 3:23:49 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> 2) Thread[id=5493, name=OverseerStateUpdate-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] 2> 676845 INFO (OverseerStateUpdate-96274232463130633-127.0.0.1:58236_solr-n_0000000002) [n:127.0.0.1:58236_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:58236_solr
[junit4] 2> Jul 20, 2016 3:23:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62), sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=es-AR, timezone=Indian/Mayotte
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=2,free=198625736,total=445120512
[junit4] 2> NOTE: All tests run in this JVM: [ResponseHeaderTest, TestBM25SimilarityFactory, HdfsNNFailoverTest, DistanceFunctionTest, TestConfigSetsAPI, TestHashPartitioner, TestCodecSupport, TestChildDocTransformer, TestMinMaxOnMultiValuedField, TestHdfsBackupRestoreCore, TestQuerySenderListener, TestAuthenticationFramework, MultiTermTest, TestNonDefinedSimilarityFactory, TermVectorComponentTest, UUIDUpdateProcessorFallbackTest, CachingDirectoryFactoryTest, TestSolrConfigHandlerConcurrent, SchemaVersionSpecificBehaviorTest, ZkSolrClientTest, TestBinaryResponseWriter, SoftAutoCommitTest, BlockJoinFacetSimpleTest, PreAnalyzedUpdateProcessorTest, DistributedMLTComponentTest, TestBackupRepositoryFactory, SimpleMLTQParserTest, TestUniqueKeyFieldResource, TestCustomSort, TestPKIAuthenticationPlugin, ClusterStateUpdateTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestHighFrequencyDictionaryFactory, SolrIndexConfigTest, TestFieldCacheVsDocValues, RulesTest, UniqFieldsUpdateProcessorFactoryTest, SegmentsInfoRequestHandlerTest, TestTrackingShardHandlerFactory, TestStressVersions, TestSmileRequest, SolrIndexSplitterTest, BJQParserTest, CustomCollectionTest, BigEndianAscendingWordDeserializerTest, AddBlockUpdateTest, SharedFSAutoReplicaFailoverTest, SpellingQueryConverterTest, TestCopyFieldCollectionResource, TestReloadDeadlock, DeleteReplicaTest, DocValuesTest, ConfigSetsAPITest, TestRequestForwarding]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRequestForwarding -Dtests.seed=EBCB947803CDF279 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-AR -Dtests.timezone=Indian/Mayotte -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestRequestForwarding (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestRequestForwarding:
[junit4] > 1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=5493, name=OverseerStateUpdate-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=TIMED_WAITING, group=Overseer state updater.]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164)
[junit4] > at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:138)
[junit4] > at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:196)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([EBCB947803CDF279]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=5495, name=OverseerHdfsCoreFailoverThread-96274232463130633-127.0.0.1:58236_solr-n_0000000002, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([EBCB947803CDF279]:0)
[junit4] Completed [194/624 (1!)] on J1 in 27.59s, 1 test, 2 errors <<< FAILURES!
[...truncated 61431 lines...]
[JENKINS] Lucene-Solr-Tests-6.x - Build # 341 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/341/
1 tests failed.
FAILED: org.apache.solr.cloud.TestHdfsCloudBackupRestore.test
Error Message:
Error from server at http://127.0.0.1:38990/solr: The backup directory already exists: hdfs://localhost:59991/backup/mytestbackup
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38990/solr: The backup directory already exists: hdfs://localhost:59991/backup/mytestbackup
at __randomizedtesting.SeedInfo.seed([B0705C4E8E343756:3824639420C85AAE]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:403)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:356)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1270)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1040)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:976)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:206)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:126)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12164 lines...]
[junit4] Suite: org.apache.solr.cloud.TestHdfsCloudBackupRestore
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/init-core-data-001
[junit4] 2> 1854249 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 1854282 WARN (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 1854291 WARN (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1854295 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1854307 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_34583_hdfs____6rrp21/webapp
[junit4] 2> 1854707 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34583
[junit4] 2> 1854791 WARN (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1854792 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1854806 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41685_datanode____.7w3g1v/webapp
[junit4] 2> 1855203 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41685
[junit4] 2> 1855259 WARN (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 1855261 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 1855273 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_60247_datanode____.uoaqfy/webapp
[junit4] 2> 1855371 INFO (IPC Server handler 3 on 59991) [ ] BlockStateChange BLOCK* processReport: from storage DS-f1c687b9-870f-4027-8861-b163964c23f0 node DatanodeRegistration(127.0.0.1:51789, datanodeUuid=9155b6be-a6e3-4a51-b0e2-f4dea4b8d2af, infoPort=43203, infoSecurePort=0, ipcPort=53917, storageInfo=lv=-56;cid=testClusterID;nsid=1008900007;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
[junit4] 2> 1855371 INFO (IPC Server handler 3 on 59991) [ ] BlockStateChange BLOCK* processReport: from storage DS-0a41a371-f1a0-4c36-a89e-1d2aa8fdf32e node DatanodeRegistration(127.0.0.1:51789, datanodeUuid=9155b6be-a6e3-4a51-b0e2-f4dea4b8d2af, infoPort=43203, infoSecurePort=0, ipcPort=53917, storageInfo=lv=-56;cid=testClusterID;nsid=1008900007;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1855784 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60247
[junit4] 2> 1855887 INFO (IPC Server handler 4 on 59991) [ ] BlockStateChange BLOCK* processReport: from storage DS-72579a38-7bf5-4cb8-93ae-95ad977098fe node DatanodeRegistration(127.0.0.1:38294, datanodeUuid=8158f68e-8a50-464b-81f4-ac8614beadab, infoPort=59216, infoSecurePort=0, ipcPort=33250, storageInfo=lv=-56;cid=testClusterID;nsid=1008900007;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
[junit4] 2> 1855888 INFO (IPC Server handler 4 on 59991) [ ] BlockStateChange BLOCK* processReport: from storage DS-0d948504-237f-4ae7-bf6d-1ac4327b5431 node DatanodeRegistration(127.0.0.1:38294, datanodeUuid=8158f68e-8a50-464b-81f4-ac8614beadab, infoPort=59216, infoSecurePort=0, ipcPort=33250, storageInfo=lv=-56;cid=testClusterID;nsid=1008900007;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
[junit4] 2> 1856068 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1856068 INFO (Thread-4695) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1856068 INFO (Thread-4695) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1856168 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:33313
[junit4] 2> 1856168 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1856169 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856170 INFO (zkCallback-2270-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@622d129b name:ZooKeeperConnection Watcher:127.0.0.1:33313 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856171 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856171 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1856171 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 1856174 INFO (jetty-launcher-2269-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1856174 INFO (jetty-launcher-2269-thread-2) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1856178 INFO (jetty-launcher-2269-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7f7766e8{/solr,null,AVAILABLE}
[junit4] 2> 1856178 INFO (jetty-launcher-2269-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@39621b20{HTTP/1.1,[http/1.1]}{127.0.0.1:50018}
[junit4] 2> 1856178 INFO (jetty-launcher-2269-thread-1) [ ] o.e.j.s.Server Started @1860744ms
[junit4] 2> 1856178 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50018}
[junit4] 2> 1856179 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
[junit4] 2> 1856179 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1'
[junit4] 2> 1856179 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1856179 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1856179 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@43b7de35{/solr,null,AVAILABLE}
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@1be41892{HTTP/1.1,[http/1.1]}{127.0.0.1:38990}
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-2) [ ] o.e.j.s.Server Started @1860747ms
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38990}
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2'
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1856181 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1856182 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1856182 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856182 INFO (zkCallback-2271-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e458f50 name:ZooKeeperConnection Watcher:127.0.0.1:33313/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856182 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856182 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1856183 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1856185 INFO (zkCallback-2272-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7224a2bd name:ZooKeeperConnection Watcher:127.0.0.1:33313/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856185 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856185 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1856188 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/.
[junit4] 2> 1856188 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 669273754
[junit4] 2> 1856188 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1]
[junit4] 2> 1856188 WARN (jetty-launcher-2269-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/lib
[junit4] 2> 1856188 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
[junit4] 2> 1856189 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1856190 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1856190 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1856190 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1856190 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33313/solr
[junit4] 2> 1856190 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1856190 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1856191 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856191 INFO (zkCallback-2275-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c37bcc5 name:ZooKeeperConnection Watcher:127.0.0.1:33313 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856192 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856192 INFO (jetty-launcher-2269-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1856193 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$105/1918929503@28a61228
[junit4] 2> 1856193 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856194 INFO (zkCallback-2276-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2d2d3837 name:ZooKeeperConnection Watcher:127.0.0.1:33313/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856194 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856194 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/.
[junit4] 2> 1856194 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.CoreContainer New CoreContainer 854274094
[junit4] 2> 1856194 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2]
[junit4] 2> 1856194 WARN (jetty-launcher-2269-thread-2) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/lib
[junit4] 2> 1856195 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
[junit4] 2> 1856195 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1856195 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1856196 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1856197 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1856197 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1856197 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33313/solr
[junit4] 2> 1856197 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1856197 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1856198 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856199 INFO (zkCallback-2279-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@18ad8328 name:ZooKeeperConnection Watcher:127.0.0.1:33313 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856199 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1856199 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856199 INFO (jetty-launcher-2269-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1856200 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$105/1918929503@7a126033
[junit4] 2> 1856202 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1856202 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856202 INFO (zkCallback-2280-thread-1-processing-n:127.0.0.1:38990_solr) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7bf83f57 name:ZooKeeperConnection Watcher:127.0.0.1:33313/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856202 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856204 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1856205 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1856206 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1856207 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1856207 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1856207 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1856208 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1856208 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1856209 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1856209 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1856210 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1856210 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1856211 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 1856211 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 1856211 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 1856211 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 1856213 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1856214 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1856214 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1856215 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1856215 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1856216 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1856216 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96282387351404548-127.0.0.1:50018_solr-n_0000000000
[junit4] 2> 1856216 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96282387351404550-127.0.0.1:38990_solr-n_0000000001
[junit4] 2> 1856216 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50018_solr
[junit4] 2> 1856216 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1856217 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96282387351404548-127.0.0.1:50018_solr-n_0000000000 to know if I could be the leader
[junit4] 2> 1856217 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38990_solr
[junit4] 2> 1856217 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38990_solr
[junit4] 2> 1856218 INFO (zkCallback-2276-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 1856218 INFO (zkCallback-2280-thread-1-processing-n:127.0.0.1:38990_solr) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 1856221 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer Overseer (id=96282387351404548-127.0.0.1:50018_solr-n_0000000000) starting
[junit4] 2> 1856227 INFO (zkCallback-2276-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1856231 INFO (zkCallback-2280-thread-1-processing-n:127.0.0.1:38990_solr) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1856238 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1856244 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1856244 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1856244 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1856245 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1856246 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 1856248 INFO (OverseerCollectionConfigSetProcessor-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1856244 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.b.r.BackupRepositoryFactory Added backup repository with configuration params {type = repository,name = hdfs,class = org.apache.solr.core.backup.repository.HdfsBackupRepository,args = {location=/backup,solr.hdfs.home=hdfs://localhost:59991/solr,solr.hdfs.confdir=}}
[junit4] 2> 1856254 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.b.r.BackupRepositoryFactory Default configuration for backup repository is with configuration params {type = repository,name = hdfs,class = org.apache.solr.core.backup.repository.HdfsBackupRepository,args = {location=/backup,solr.hdfs.home=hdfs://localhost:59991/solr,solr.hdfs.confdir=}}
[junit4] 2> 1856254 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/.
[junit4] 2> 1856255 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 1856255 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:50018_solr as DOWN
[junit4] 2> 1856255 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 1856256 INFO (jetty-launcher-2269-thread-2) [n:127.0.0.1:38990_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1856256 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50018_solr
[junit4] 2> 1856256 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50018_solr
[junit4] 2> 1856257 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:50018_solr"} current state version: 0
[junit4] 2> 1856257 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:50018_solr
[junit4] 2> 1856258 INFO (zkCallback-2276-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1856258 INFO (zkCallback-2276-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1856259 INFO (zkCallback-2280-thread-1-processing-n:127.0.0.1:38990_solr) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1856261 INFO (zkCallback-2280-thread-1-processing-n:127.0.0.1:38990_solr) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1856269 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1856276 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1856276 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.b.r.BackupRepositoryFactory Added backup repository with configuration params {type = repository,name = hdfs,class = org.apache.solr.core.backup.repository.HdfsBackupRepository,args = {location=/backup,solr.hdfs.home=hdfs://localhost:59991/solr,solr.hdfs.confdir=}}
[junit4] 2> 1856276 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.b.r.BackupRepositoryFactory Default configuration for backup repository is with configuration params {type = repository,name = hdfs,class = org.apache.solr.core.backup.repository.HdfsBackupRepository,args = {location=/backup,solr.hdfs.home=hdfs://localhost:59991/solr,solr.hdfs.confdir=}}
[junit4] 2> 1856276 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/.
[junit4] 2> 1856277 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 1856277 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 1856278 INFO (jetty-launcher-2269-thread-1) [n:127.0.0.1:50018_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1856278 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1856278 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856279 INFO (zkCallback-2283-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c3a7bf6 name:ZooKeeperConnection Watcher:127.0.0.1:33313 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856279 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856279 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1856280 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1856285 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1856286 INFO (zkCallback-2286-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d7c951d name:ZooKeeperConnection Watcher:127.0.0.1:33313/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1856286 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1856286 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1856286 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1856286 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 1856287 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1856288 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1856290 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1856341 INFO (TEST-TestHdfsCloudBackupRestore.test-seed#[B0705C4E8E343756]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 1856343 INFO (qtp1323303114-14753) [n:127.0.0.1:50018_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&property.customKey=customValue&collection.configName=conf1&maxShardsPerNode=2&autoAddReplicas=true&name=hdfsbackuprestore&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1856345 INFO (OverseerCollectionConfigSetProcessor-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "name":"hdfsbackuprestore",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"true",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "property.customKey":"customValue",
[junit4] 2> "operation":"create"}
[junit4] 2> 1856346 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"hdfsbackuprestore",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"true",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "property.customKey":"customValue",
[junit4] 2> "operation":"create"}
[junit4] 2> 1856346 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerCollectionMessageHandler Create collection hdfsbackuprestore
[junit4] 2> 1856346 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/hdfsbackuprestore
[junit4] 2> 1856346 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.SolrZkClient makePath: /collections/hdfsbackuprestore
[junit4] 2> 1856347 INFO (zkCallback-2286-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 1856347 INFO (zkCallback-2280-thread-1-processing-n:127.0.0.1:38990_solr) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 1856348 INFO (zkCallback-2276-thread-2-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 1856350 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"hdfsbackuprestore",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "autoAddReplicas":"true",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "property.customKey":"customValue",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 1856350 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: hdfsbackuprestore
[junit4] 2> 1856351 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/hdfsbackuprestore/state.json
[junit4] 2> 1856450 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection hdfsbackuprestore, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 1856450 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating core hdfsbackuprestore_shard1_replica1 as part of shard shard1 of collection hdfsbackuprestore on 127.0.0.1:38990_solr
[junit4] 2> 1856451 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating core hdfsbackuprestore_shard2_replica2 as part of shard shard2 of collection hdfsbackuprestore on 127.0.0.1:50018_solr
[junit4] 2> 1856451 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating core hdfsbackuprestore_shard2_replica1 as part of shard shard2 of collection hdfsbackuprestore on 127.0.0.1:38990_solr
[junit4] 2> 1856452 INFO (OverseerThreadFactory-6221-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating core hdfsbackuprestore_shard1_replica2 as part of shard shard1 of collection hdfsbackuprestore on 127.0.0.1:50018_solr
[junit4] 2> 1856454 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr ] o.a.s.h.a.CoreAdminOperation core create command property.customKey=customValue&qt=/admin/cores&collection.configName=conf1&name=hdfsbackuprestore_shard1_replica1&action=CREATE&numShards=2&collection=hdfsbackuprestore&shard=shard1&wt=javabin&version=2
[junit4] 2> 1856454 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=hdfsbackuprestore_shard1_replica1, collection.configName=conf1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=hdfsbackuprestore, customKey=customValue, numShards=2, dataDir=data/, shard=shard1}
[junit4] 2> 1856461 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr ] o.a.s.h.a.CoreAdminOperation core create command property.customKey=customValue&qt=/admin/cores&collection.configName=conf1&name=hdfsbackuprestore_shard2_replica2&action=CREATE&numShards=2&collection=hdfsbackuprestore&shard=shard2&wt=javabin&version=2
[junit4] 2> 1856461 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr ] o.a.s.h.a.CoreAdminOperation core create command property.customKey=customValue&qt=/admin/cores&collection.configName=conf1&name=hdfsbackuprestore_shard1_replica2&action=CREATE&numShards=2&collection=hdfsbackuprestore&shard=shard1&wt=javabin&version=2
[junit4] 2> 1856462 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=hdfsbackuprestore_shard2_replica2, collection.configName=conf1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=hdfsbackuprestore, customKey=customValue, numShards=2, dataDir=data/, shard=shard2}
[junit4] 2> 1856462 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=hdfsbackuprestore_shard1_replica2, collection.configName=conf1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=hdfsbackuprestore, customKey=customValue, numShards=2, dataDir=data/, shard=shard1}
[junit4] 2> 1856462 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr ] o.a.s.h.a.CoreAdminOperation core create command property.customKey=customValue&qt=/admin/cores&collection.configName=conf1&name=hdfsbackuprestore_shard2_replica1&action=CREATE&numShards=2&collection=hdfsbackuprestore&shard=shard2&wt=javabin&version=2
[junit4] 2> 1856462 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1856462 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=hdfsbackuprestore_shard2_replica1, collection.configName=conf1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=hdfsbackuprestore, customKey=customValue, numShards=2, dataDir=data/, shard=shard2}
[junit4] 2> 1856463 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1856463 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1856463 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1856464 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.ZkController Registering watch for collection hdfsbackuprestore
[junit4] 2> 1856464 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.ZkController Registering watch for collection hdfsbackuprestore
[junit4] 2> 1856464 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1856464 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.ZkController Registering watch for collection hdfsbackuprestore
[junit4] 2> 1856464 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.c.ZkStateReader Add data for [hdfsbackuprestore] ver [0]
[junit4] 2> 1856466 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1856466 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.ZkController Registering watch for collection hdfsbackuprestore
[junit4] 2> 1856466 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1856466 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.c.ZkStateReader Add data for [hdfsbackuprestore] ver [0]
[junit4] 2> 1856466 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1856467 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer processMessage: queueSize: 4, message = {
[junit4] 2> "core":"hdfsbackuprestore_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:38990/solr",
[junit4] 2> "node_name":"127.0.0.1:38990_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"hdfsbackuprestore",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1856467 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"hdfsbackuprestore_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:38990/solr",
[junit4] 2> "node_name":"127.0.0.1:38990_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"hdfsbackuprestore",
[junit4] 2> "operation":"state"}
[junit4] 2> 1856468 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "core":"hdfsbackuprestore_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50018/solr",
[junit4] 2> "node_name":"127.0.0.1:50018_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"hdfsbackuprestore",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1856468 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"hdfsbackuprestore_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50018/solr",
[junit4] 2> "node_name":"127.0.0.1:50018_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"hdfsbackuprestore",
[junit4] 2> "operation":"state"}
[junit4] 2> 1856470 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"hdfsbackuprestore_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50018/solr",
[junit4] 2> "node_name":"127.0.0.1:50018_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"hdfsbackuprestore",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1856470 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"hdfsbackuprestore_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:50018/solr",
[junit4] 2> "node_name":"127.0.0.1:50018_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"hdfsbackuprestore",
[junit4] 2> "operation":"state"}
[junit4] 2> 1856471 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"hdfsbackuprestore_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:38990/solr",
[junit4] 2> "node_name":"127.0.0.1:38990_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"hdfsbackuprestore",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1856471 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"hdfsbackuprestore_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:38990/solr",
[junit4] 2> "node_name":"127.0.0.1:38990_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"hdfsbackuprestore",
[junit4] 2> "operation":"state"}
[junit4] 2> 1856573 INFO (OverseerStateUpdate-96282387351404548-127.0.0.1:50018_solr-n_0000000000) [n:127.0.0.1:50018_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/hdfsbackuprestore/state.json version: 0
[junit4] 2> 1856574 INFO (zkCallback-2276-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/hdfsbackuprestore/state.json] for collection [hdfsbackuprestore] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1856574 INFO (zkCallback-2280-thread-1-processing-n:127.0.0.1:38990_solr) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/hdfsbackuprestore/state.json] for collection [hdfsbackuprestore] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1856574 INFO (zkCallback-2280-thread-1-processing-n:127.0.0.1:38990_solr) [n:127.0.0.1:38990_solr ] o.a.s.c.c.ZkStateReader Updating data for [hdfsbackuprestore] from [0] to [1]
[junit4] 2> 1856574 INFO (zkCallback-2276-thread-1-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.c.ZkStateReader Updating data for [hdfsbackuprestore] from [0] to [1]
[junit4] 2> 1857466 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.ZkController waiting to find shard id in clusterstate for hdfsbackuprestore_shard1_replica1
[junit4] 2> 1857466 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.ZkController waiting to find shard id in clusterstate for hdfsbackuprestore_shard2_replica1
[junit4] 2> 1857466 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.ZkController Check for collection zkNode:hdfsbackuprestore
[junit4] 2> 1857466 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.ZkController Check for collection zkNode:hdfsbackuprestore
[junit4] 2> 1857467 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.ZkController waiting to find shard id in clusterstate for hdfsbackuprestore_shard2_replica2
[junit4] 2> 1857467 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.ZkController waiting to find shard id in clusterstate for hdfsbackuprestore_shard1_replica2
[junit4] 2> 1857467 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.ZkController Check for collection zkNode:hdfsbackuprestore
[junit4] 2> 1857467 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.ZkController Check for collection zkNode:hdfsbackuprestore
[junit4] 2> 1857467 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1857467 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1857467 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/hdfsbackuprestore]
[junit4] 2> 1857467 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/hdfsbackuprestore]
[junit4] 2> 1857467 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1857467 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/hdfsbackuprestore]
[junit4] 2> 1857467 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1857467 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/hdfsbackuprestore]
[junit4] 2> 1857468 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.c.ZkStateReader path=[/collections/hdfsbackuprestore] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1857468 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard2_replica1'
[junit4] 2> 1857468 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1857468 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1857469 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.c.ZkStateReader path=[/collections/hdfsbackuprestore] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1857469 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.c.ZkStateReader path=[/collections/hdfsbackuprestore] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1857469 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard2_replica2'
[junit4] 2> 1857469 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard1_replica1'
[junit4] 2> 1857469 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1857469 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1857469 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1857470 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1857470 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.c.ZkStateReader path=[/collections/hdfsbackuprestore] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 1857470 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard1_replica2'
[junit4] 2> 1857471 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1857471 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1857471 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1857472 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1857472 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1857473 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1857475 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1857475 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1857475 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1857477 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
[junit4] 2> 1857478 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
[junit4] 2> 1857480 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1857481 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
[junit4] 2> 1857482 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
[junit4] 2> 1857482 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1857486 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.s.IndexSchema [hdfsbackuprestore_shard2_replica1] Schema name=minimal
[junit4] 2> 1857487 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1857505 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1857505 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1857505 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.s.IndexSchema [hdfsbackuprestore_shard1_replica2] Schema name=minimal
[junit4] 2> 1857506 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 1857507 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard2_replica1' using configuration from collection hdfsbackuprestore
[junit4] 2> 1857507 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1857507 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrCore [[hdfsbackuprestore_shard2_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard2_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/./hdfsbackuprestore_shard2_replica1/data/]
[junit4] 2> 1857507 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrCore JMX monitoring not detected for core: hdfsbackuprestore_shard2_replica1
[junit4] 2> 1857508 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1857508 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard2_replica1/data
[junit4] 2> 1857509 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1857509 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/./hdfsbackuprestore_shard2_replica1/data/index/
[junit4] 2> 1857509 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 1857509 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard1_replica2' using configuration from collection hdfsbackuprestore
[junit4] 2> 1857509 WARN (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrCore [hdfsbackuprestore_shard2_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/./hdfsbackuprestore_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1857510 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1857510 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrCore [[hdfsbackuprestore_shard1_replica2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard1_replica2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/./hdfsbackuprestore_shard1_replica2/data/]
[junit4] 2> 1857510 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrCore JMX monitoring not detected for core: hdfsbackuprestore_shard1_replica2
[junit4] 2> 1857510 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard2_replica1/data/index
[junit4] 2> 1857510 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.s.IndexSchema [hdfsbackuprestore_shard2_replica2] Schema name=minimal
[junit4] 2> 1857511 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard1_replica2/data
[junit4] 2> 1857511 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/./hdfsbackuprestore_shard1_replica2/data/index/
[junit4] 2> 1857511 WARN (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrCore [hdfsbackuprestore_shard1_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/./hdfsbackuprestore_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1857512 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard1_replica2/data/index
[junit4] 2> 1857513 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1857516 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.s.IndexSchema [hdfsbackuprestore_shard1_replica1] Schema name=minimal
[junit4] 2> 1857518 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard2_replica1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1857518 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1857518 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1857519 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard1_replica2/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1857519 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1857519 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 1857519 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard2_replica2' using configuration from collection hdfsbackuprestore
[junit4] 2> 1857519 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 r:core_node2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1857519 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 r:core_node2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrCore [[hdfsbackuprestore_shard2_replica2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard2_replica2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/./hdfsbackuprestore_shard2_replica2/data/]
[junit4] 2> 1857519 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 r:core_node2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrCore JMX monitoring not detected for core: hdfsbackuprestore_shard2_replica2
[junit4] 2> 1857520 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1857520 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
[junit4] 2> 1857520 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'hdfsbackuprestore_shard1_replica1' using configuration from collection hdfsbackuprestore
[junit4] 2> 1857520 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1857520 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 r:core_node1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1857521 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 r:core_node1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrCore [[hdfsbackuprestore_shard1_replica1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard1_replica1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/./hdfsbackuprestore_shard1_replica1/data/]
[junit4] 2> 1857521 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 r:core_node1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrCore JMX monitoring not detected for core: hdfsbackuprestore_shard1_replica1
[junit4] 2> 1857521 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 r:core_node2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard2_replica2/data
[junit4] 2> 1857522 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 r:core_node2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/./hdfsbackuprestore_shard2_replica2/data/index/
[junit4] 2> 1857522 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1857522 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1857522 WARN (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 r:core_node2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.SolrCore [hdfsbackuprestore_shard2_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/./hdfsbackuprestore_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1857523 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1857523 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1857523 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 r:core_node1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard1_replica1/data
[junit4] 2> 1857523 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 r:core_node1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/./hdfsbackuprestore_shard1_replica1/data/index/
[junit4] 2> 1857523 WARN (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 r:core_node1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.SolrCore [hdfsbackuprestore_shard1_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/./hdfsbackuprestore_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1857523 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1857523 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1857523 INFO (qtp251911639-14763) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard1 r:core_node1 x:hdfsbackuprestore_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node2/hdfsbackuprestore_shard1_replica1/data/index
[junit4] 2> 1857524 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1857524 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1857525 INFO (qtp1323303114-14755) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard2 r:core_node2 x:hdfsbackuprestore_shard2_replica2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001/tempDir-002/node1/hdfsbackuprestore_shard2_replica2/data/index
[junit4] 2> 1857525 INFO (qtp1323303114-14757) [n:127.0.0.1:50018_solr c:hdfsbackuprestore s:shard1 r:core_node3 x:hdfsbackuprestore_shard1_replica2] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/select,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms
[junit4] 2> 1857525 INFO (qtp251911639-14761) [n:127.0.0.1:38990_solr c:hdfsbackuprestore s:shard2 r:core_node4 x:hdfsbackuprestore_shard2_replica1]
[...truncated too long message...]
ava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1883879 WARN (zkCallback-2276-thread-6-processing-n:127.0.0.1:50018_solr) [n:127.0.0.1:50018_solr ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/hdfsbackuprestore/leader_elect/shard1_0/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:331)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:328)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:328)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:105)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1883879 INFO (jetty-launcher-2269-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7f7766e8{/solr,null,UNAVAILABLE}
[junit4] 2> 1883879 ERROR (jetty-launcher-2269-thread-1-EventThread) [n:127.0.0.1:50018_solr ] o.a.z.ClientCnxn Error while calling watcher
[junit4] 2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$28/906745993@4e4c0978 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@5e02c50a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 203]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> 1883880 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33313 33313
[junit4] 2> 1884051 INFO (Thread-4695) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33313 33313
[junit4] 2> 1884052 WARN (Thread-4695) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 2 /solr/collections/hdfsbackuprestore/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 25 /solr/overseer/queue
[junit4] 2> 17 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 1884053 INFO (SUITE-TestHdfsCloudBackupRestore-seed#[B0705C4E8E343756]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestHdfsCloudBackupRestore_B0705C4E8E343756-001
[junit4] 2> Jul 22, 2016 1:57:47 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {shard_s=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Memory doPackFST= true), id=Lucene50(blocksize=128)}, docValues:{}, maxPointsInLeafNode=514, maxMBSortInHeap=5.54348593827289, sim=ClassicSimilarity, locale=en-IE, timezone=America/Indiana/Knox
[junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=2,free=187546896,total=510656512
[junit4] 2> NOTE: All tests run in this JVM: [TestDistributedStatsComponentCardinality, DistributedFacetPivotLargeTest, TestSolrConfigHandler, TestPartialUpdateDeduplication, TestSimpleTrackingShardHandler, TermsComponentTest, TestSolrDeletionPolicy2, DistributedTermsComponentTest, ZkControllerTest, HdfsNNFailoverTest, AtomicUpdatesTest, UniqFieldsUpdateProcessorFactoryTest, TestCustomSort, ClusterStateUpdateTest, TestDocTermOrds, MultiTermTest, TestBinaryResponseWriter, TestRawTransformer, AliasIntegrationTest, TestLFUCache, TestBlendedInfixSuggestions, TestFastLRUCache, HLLUtilTest, FileUtilsTest, DocumentBuilderTest, SpellCheckCollatorTest, MinimalSchemaTest, TestCoreContainer, ResponseHeaderTest, TestMiniSolrCloudCluster, SharedFSAutoReplicaFailoverTest, StressHdfsTest, HdfsRestartWhileUpdatingTest, TestTrackingShardHandlerFactory, TestFiltering, ZkStateWriterTest, CollectionReloadTest, SimpleMLTQParserTest, SpatialRPTFieldTypeTest, TestSmileRequest, BufferStoreTest, TestBM25SimilarityFactory, LeaderInitiatedRecoveryOnShardRestartTest, ReplicationFactorTest, AddBlockUpdateTest, TestSolrConfigHandlerConcurrent, ShardRoutingTest, TestGeoJSONResponseWriter, ExplicitHLLTest, SpellingQueryConverterTest, TermVectorComponentTest, DistributedMLTComponentTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestNonDefinedSimilarityFactory, DistribCursorPagingTest, BasicFunctionalityTest, OverseerModifyCollectionTest, OpenExchangeRatesOrgProviderTest, TestRequestForwarding, SpellCheckComponentTest, TestSubQueryTransformerDistrib, MoreLikeThisHandlerTest, TestCursorMarkWithoutUniqueKey, AnalyticsQueryTest, BlockJoinFacetSimpleTest, SimplePostToolTest, HighlighterTest, TestQuerySenderListener, TestMiniSolrCloudClusterSSL, TestEmbeddedSolrServerConstructors, SolrPluginUtilsTest, DateRangeFieldTest, MBeansHandlerTest, CustomCollectionTest, SoftAutoCommitTest, SpatialHeatmapFacetsTest, TestSolrCoreProperties, TestScoreJoinQPScore, TestCloudPivotFacet, RankQueryTest, CollectionsAPIDistributedZkTest, SolrCmdDistributorTest, TestUseDocValuesAsStored, RequestLoggingTest, TestHdfsUpdateLog, TestQueryTypes, TestStressVersions, LoggingHandlerTest, TestFieldCacheSanityChecker, ExitableDirectoryReaderTest, TestSlowCompositeReaderWrapper, SolrIndexConfigTest, NumericFieldsTest, TestBackupRepositoryFactory, TestIntervalFaceting, SegmentsInfoRequestHandlerTest, NotRequiredUniqueKeyTest, SpatialFilterTest, TestPseudoReturnFields, TestUpdate, TestAtomicUpdateErrorCases, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestValueSourceCache, TestArbitraryIndexDir, ReturnFieldsTest, BinaryUpdateRequestHandlerTest, CSVRequestHandlerTest, UpdateParamsTest, TestQuerySenderNoQuery, CopyFieldTest, TestDocSet, TestSearchPerf, OutputWriterTest, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, DirectSolrConnectionTest, SpellPossibilityIteratorTest, TestCodecSupport, TestSweetSpotSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TimeZoneUtilsTest, TestFastOutputStream, PluginInfoTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, DOMUtilTest, RAMDirectoryFactoryTest, TestLRUCache, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SystemInfoHandlerTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, CreateCollectionCleanupTest, DeleteReplicaTest, LeaderFailoverAfterPartitionTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, RollingRestartTest, SharedFSAutoReplicaFailoverUtilsTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, TestCloudDeleteByQuery, TestDistribDocBasedVersion, TestDownShardTolerantSearch, TestHdfsCloudBackupRestore]
[junit4] Completed [474/624 (1!)] on J1 in 39.44s, 1 test, 1 error <<< FAILURES!
[...truncated 60592 lines...]