You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/06/26 21:53:38 UTC
[JENKINS] Lucene-Solr-6.x-Solaris (64bit/jdk1.8.0) - Build # 223 -
Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Solaris/223/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CloudExitableDirectoryReaderTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.CloudExitableDirectoryReaderTest: 1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CloudExitableDirectoryReaderTest:
1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([9478B3F64D931A5A]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CloudExitableDirectoryReaderTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.interrupt0(Native Method) at java.lang.Thread.interrupt(Thread.java:923) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.interrupt0(Native Method)
at java.lang.Thread.interrupt(Thread.java:923)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([9478B3F64D931A5A]:0)
Build Log:
[...truncated 11085 lines...]
[junit4] Suite: org.apache.solr.cloud.CloudExitableDirectoryReaderTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/init-core-data-001
[junit4] 2> 1026361 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 1026362 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1026362 INFO (Thread-2784) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1026362 INFO (Thread-2784) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1026462 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:61389
[junit4] 2> 1026462 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1026462 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1026471 INFO (zkCallback-1373-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2acc4afa name:ZooKeeperConnection Watcher:127.0.0.1:61389 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1026471 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1026471 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1026471 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 1026485 INFO (jetty-launcher-1372-thread-2) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1026485 INFO (jetty-launcher-1372-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1026487 INFO (jetty-launcher-1372-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14e8e286{/solr,null,AVAILABLE}
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48db5edd{/solr,null,AVAILABLE}
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@1f133823{HTTP/1.1,[http/1.1]}{127.0.0.1:56126}
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-2) [ ] o.e.j.s.Server Started @1031358ms
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=56126}
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2'
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@388e559e{HTTP/1.1,[http/1.1]}{127.0.0.1:33654}
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-1) [ ] o.e.j.s.Server Started @1031359ms
[junit4] 2> 1026488 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33654}
[junit4] 2> 1026489 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1026489 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 1026489 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1'
[junit4] 2> 1026489 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1026489 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1026489 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1026490 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1026493 INFO (zkCallback-1374-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@798b44c5 name:ZooKeeperConnection Watcher:127.0.0.1:61389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1026494 INFO (zkCallback-1375-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6778bdaf name:ZooKeeperConnection Watcher:127.0.0.1:61389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1026494 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1026494 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1026494 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1026494 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1026494 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1026494 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1026500 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/.
[junit4] 2> 1026501 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/.
[junit4] 2> 1026501 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 1304265125
[junit4] 2> 1026501 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.CoreContainer New CoreContainer 1507512927
[junit4] 2> 1026501 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1]
[junit4] 2> 1026501 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2]
[junit4] 2> 1026501 WARN (jetty-launcher-1372-thread-2) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/lib
[junit4] 2> 1026501 WARN (jetty-launcher-1372-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/lib
[junit4] 2> 1026501 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1026501 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1026504 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1026504 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1026505 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1026505 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1026505 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61389/solr
[junit4] 2> 1026505 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1026506 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1026505 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1026506 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1026506 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61389/solr
[junit4] 2> 1026506 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1026506 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1026506 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1026506 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1026509 INFO (zkCallback-1381-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6928852c name:ZooKeeperConnection Watcher:127.0.0.1:61389 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1026509 INFO (zkCallback-1380-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3363119b name:ZooKeeperConnection Watcher:127.0.0.1:61389 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1026509 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1026509 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1026509 INFO (jetty-launcher-1372-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1026509 INFO (jetty-launcher-1372-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1026511 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$12/562713707@4f430615
[junit4] 2> 1026511 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$12/562713707@7d80ac74
[junit4] 2> 1026511 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1026511 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1026512 INFO (zkCallback-1382-thread-1-processing-n:127.0.0.1:56126_solr) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2eddbf01 name:ZooKeeperConnection Watcher:127.0.0.1:61389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1026513 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1026513 INFO (zkCallback-1383-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@366355fb name:ZooKeeperConnection Watcher:127.0.0.1:61389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1026513 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1026514 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1026514 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1026517 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1026518 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1026521 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1026521 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1026524 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1026524 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1026527 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1026528 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1026530 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1026530 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1026531 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1026532 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1026533 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1026533 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1026535 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1026535 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1026536 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1026537 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1026538 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1026538 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1026538 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 1026539 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 1026540 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 1026540 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 1026543 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1026544 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1026545 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1026545 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1026547 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1026547 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96139812186882054-127.0.0.1:33654_solr-n_0000000000
[junit4] 2> 1026547 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1026548 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33654_solr
[junit4] 2> 1026548 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1026548 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96139812186882053-127.0.0.1:56126_solr-n_0000000001
[junit4] 2> 1026549 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96139812186882054-127.0.0.1:33654_solr-n_0000000000 to know if I could be the leader
[junit4] 2> 1026549 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56126_solr
[junit4] 2> 1026550 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56126_solr
[junit4] 2> 1026550 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.Overseer Overseer (id=96139812186882054-127.0.0.1:33654_solr-n_0000000000) starting
[junit4] 2> 1026552 INFO (zkCallback-1382-thread-1-processing-n:127.0.0.1:56126_solr) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 1026552 INFO (zkCallback-1383-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 1026553 INFO (zkCallback-1382-thread-1-processing-n:127.0.0.1:56126_solr) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1026553 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1026553 INFO (zkCallback-1383-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1026561 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1026562 INFO (OverseerCollectionConfigSetProcessor-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1026562 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1026563 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:33654_solr as DOWN
[junit4] 2> 1026565 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 1026566 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:33654_solr"} current state version: 0
[junit4] 2> 1026566 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:33654_solr
[junit4] 2> 1026574 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1026574 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1026575 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/.
[junit4] 2> 1026575 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 1026577 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0
[junit4] 2> 1026577 INFO (jetty-launcher-1372-thread-2) [n:127.0.0.1:56126_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1027565 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33654_solr
[junit4] 2> 1027566 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:33654_solr
[junit4] 2> 1027568 INFO (zkCallback-1383-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1027568 INFO (zkCallback-1382-thread-1-processing-n:127.0.0.1:56126_solr) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1027568 INFO (zkCallback-1383-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1027569 INFO (zkCallback-1382-thread-1-processing-n:127.0.0.1:56126_solr) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1027592 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1027593 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1027593 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/.
[junit4] 2> 1027593 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 1027594 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0
[junit4] 2> 1027594 INFO (jetty-launcher-1372-thread-1) [n:127.0.0.1:33654_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1027595 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1027595 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1027596 INFO (zkCallback-1386-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67c8255d name:ZooKeeperConnection Watcher:127.0.0.1:61389 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1027596 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1027597 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1027598 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.s.i.CloudSolrClient Final constructed zkHost string: 127.0.0.1:61389/solr
[junit4] 2> 1027598 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1027599 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1027600 INFO (zkCallback-1389-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@291a028a name:ZooKeeperConnection Watcher:127.0.0.1:61389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1027600 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1027601 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1027601 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1027602 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 1027603 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1027605 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf/schema.xml
[junit4] 2> 1027609 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf/solrconfig.xml
[junit4] 2> 1027621 INFO (qtp631021356-8004) [n:127.0.0.1:56126_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=39b18759-7d17-445d-97b6-370f950394f8&replicationFactor=1&collection.configName=conf&name=exitable&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1027623 INFO (qtp631021356-8004) [n:127.0.0.1:56126_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=39b18759-7d17-445d-97b6-370f950394f8&replicationFactor=1&collection.configName=conf&name=exitable&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1027624 INFO (OverseerCollectionConfigSetProcessor-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running/mn-39b18759-7d17-445d-97b6-370f950394f8
[junit4] 2> 1027626 INFO (qtp631021356-8006) [n:127.0.0.1:56126_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=39b18759-7d17-445d-97b6-370f950394f8&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1027627 INFO (OverseerCollectionConfigSetProcessor-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "name":"exitable",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"conf",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "async":"39b18759-7d17-445d-97b6-370f950394f8",
[junit4] 2> "operation":"create"}
[junit4] 2> 1027627 INFO (qtp631021356-8006) [n:127.0.0.1:56126_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=39b18759-7d17-445d-97b6-370f950394f8&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1027631 INFO (OverseerThreadFactory-3241-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"exitable",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"conf",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "async":"39b18759-7d17-445d-97b6-370f950394f8",
[junit4] 2> "operation":"create"}
[junit4] 2> 1027631 INFO (OverseerThreadFactory-3241-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerCollectionMessageHandler Create collection exitable
[junit4] 2> 1027632 INFO (OverseerThreadFactory-3241-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/exitable
[junit4] 2> 1027632 INFO (OverseerThreadFactory-3241-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.SolrZkClient makePath: /collections/exitable
[junit4] 2> 1027633 INFO (zkCallback-1383-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 1027634 INFO (zkCallback-1382-thread-1-processing-n:127.0.0.1:56126_solr) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 1027636 INFO (zkCallback-1389-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 1027636 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"exitable",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"conf",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "async":"39b18759-7d17-445d-97b6-370f950394f8",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 1027636 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: exitable
[junit4] 2> 1027638 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/exitable/state.json
[junit4] 2> 1027745 INFO (OverseerThreadFactory-3241-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection exitable, shardNames [shard1, shard2] , replicationFactor : 1
[junit4] 2> 1027745 INFO (OverseerThreadFactory-3241-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating core exitable_shard1_replica1 as part of shard shard1 of collection exitable on 127.0.0.1:33654_solr
[junit4] 2> 1027745 INFO (OverseerThreadFactory-3241-thread-1-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating core exitable_shard2_replica1 as part of shard shard2 of collection exitable on 127.0.0.1:56126_solr
[junit4] 2> 1027751 INFO (qtp1865825484-8009) [n:127.0.0.1:33654_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=39b18759-7d17-445d-97b6-370f950394f8119827635383920&qt=/admin/cores&collection.configName=conf&name=exitable_shard1_replica1&action=CREATE&numShards=2&collection=exitable&shard=shard1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1027751 INFO (qtp631021356-8015) [n:127.0.0.1:56126_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=39b18759-7d17-445d-97b6-370f950394f8119827635621064&qt=/admin/cores&collection.configName=conf&name=exitable_shard2_replica1&action=CREATE&numShards=2&collection=exitable&shard=shard2&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1027752 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr ] o.a.s.h.a.CoreAdminOperation core create command async=39b18759-7d17-445d-97b6-370f950394f8119827635383920&qt=/admin/cores&collection.configName=conf&name=exitable_shard1_replica1&action=CREATE&numShards=2&collection=exitable&shard=shard1&wt=javabin&version=2
[junit4] 2> 1027752 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr ] o.a.s.h.a.CoreAdminOperation core create command async=39b18759-7d17-445d-97b6-370f950394f8119827635621064&qt=/admin/cores&collection.configName=conf&name=exitable_shard2_replica1&action=CREATE&numShards=2&collection=exitable&shard=shard2&wt=javabin&version=2
[junit4] 2> 1027752 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=exitable_shard1_replica1, collection.configName=conf, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=exitable, numShards=2, dataDir=data/, shard=shard1}
[junit4] 2> 1027752 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=exitable_shard2_replica1, collection.configName=conf, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=exitable, numShards=2, dataDir=data/, shard=shard2}
[junit4] 2> 1027753 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1027753 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1027754 INFO (qtp1865825484-8010) [n:127.0.0.1:33654_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 39b18759-7d17-445d-97b6-370f950394f8119827635383920
[junit4] 2> 1027755 INFO (qtp1865825484-8010) [n:127.0.0.1:33654_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=39b18759-7d17-445d-97b6-370f950394f8119827635383920&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1027755 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.ZkController Registering watch for collection exitable
[junit4] 2> 1027755 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.ZkController Registering watch for collection exitable
[junit4] 2> 1027756 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "core":"exitable_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33654/solr",
[junit4] 2> "node_name":"127.0.0.1:33654_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"exitable",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1027756 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.c.ZkStateReader Add data for [exitable] ver [0]
[junit4] 2> 1027756 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"exitable_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:33654/solr",
[junit4] 2> "node_name":"127.0.0.1:33654_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"exitable",
[junit4] 2> "operation":"state"}
[junit4] 2> 1027756 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.c.ZkStateReader Add data for [exitable] ver [0]
[junit4] 2> 1027756 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1027757 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1027760 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"exitable_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56126/solr",
[junit4] 2> "node_name":"127.0.0.1:56126_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"exitable",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1027760 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"exitable_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56126/solr",
[junit4] 2> "node_name":"127.0.0.1:56126_solr",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"exitable",
[junit4] 2> "operation":"state"}
[junit4] 2> 1027864 INFO (OverseerStateUpdate-96139812186882054-127.0.0.1:33654_solr-n_0000000000) [n:127.0.0.1:33654_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/exitable/state.json version: 0
[junit4] 2> 1027865 INFO (zkCallback-1383-thread-3-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/exitable/state.json] for collection [exitable] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1027865 INFO (zkCallback-1382-thread-1-processing-n:127.0.0.1:56126_solr) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/exitable/state.json] for collection [exitable] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1027866 INFO (zkCallback-1383-thread-3-processing-n:127.0.0.1:33654_solr) [n:127.0.0.1:33654_solr ] o.a.s.c.c.ZkStateReader Updating data for [exitable] from [0] to [1]
[junit4] 2> 1027866 INFO (zkCallback-1382-thread-1-processing-n:127.0.0.1:56126_solr) [n:127.0.0.1:56126_solr ] o.a.s.c.c.ZkStateReader Updating data for [exitable] from [0] to [1]
[junit4] 2> 1028634 INFO (qtp631021356-8018) [n:127.0.0.1:56126_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=39b18759-7d17-445d-97b6-370f950394f8&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1028636 INFO (qtp631021356-8018) [n:127.0.0.1:56126_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=39b18759-7d17-445d-97b6-370f950394f8&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1028757 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.ZkController waiting to find shard id in clusterstate for exitable_shard2_replica1
[junit4] 2> 1028757 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.ZkController Check for collection zkNode:exitable
[junit4] 2> 1028757 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.ZkController waiting to find shard id in clusterstate for exitable_shard1_replica1
[junit4] 2> 1028758 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.ZkController Check for collection zkNode:exitable
[junit4] 2> 1028758 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1028758 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/exitable]
[junit4] 2> 1028758 INFO (qtp1865825484-8011) [n:127.0.0.1:33654_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 39b18759-7d17-445d-97b6-370f950394f8119827635383920
[junit4] 2> 1028758 INFO (qtp1865825484-8011) [n:127.0.0.1:33654_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=39b18759-7d17-445d-97b6-370f950394f8119827635383920&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1028758 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1028759 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/exitable]
[junit4] 2> 1028760 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.c.ZkStateReader path=[/collections/exitable] [configName]=[conf] specified config exists in ZooKeeper
[junit4] 2> 1028760 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.c.ZkStateReader path=[/collections/exitable] [configName]=[conf] specified config exists in ZooKeeper
[junit4] 2> 1028760 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/exitable_shard2_replica1'
[junit4] 2> 1028760 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/exitable_shard1_replica1'
[junit4] 2> 1028760 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1028760 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1028760 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1028760 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1028762 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1028762 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1028766 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1028767 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1028769 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
[junit4] 2> 1028774 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
[junit4] 2> 1028779 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1028779 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1028782 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.s.IndexSchema [exitable_shard1_replica1] Schema name=minimal
[junit4] 2> 1028782 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.s.IndexSchema [exitable_shard2_replica1] Schema name=minimal
[junit4] 2> 1028785 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1028785 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1028786 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf', cwd=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0
[junit4] 2> 1028786 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf', cwd=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0
[junit4] 2> 1028786 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 x:exitable_shard2_replica1] o.a.s.c.CoreContainer Creating SolrCore 'exitable_shard2_replica1' using configuration from collection exitable
[junit4] 2> 1028786 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 x:exitable_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'exitable_shard1_replica1' using configuration from collection exitable
[junit4] 2> 1028787 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1028787 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1028787 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrCore [[exitable_shard2_replica1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/exitable_shard2_replica1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/./exitable_shard2_replica1/data/]
[junit4] 2> 1028787 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrCore [[exitable_shard1_replica1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/exitable_shard1_replica1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/./exitable_shard1_replica1/data/]
[junit4] 2> 1028787 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49aba87c
[junit4] 2> 1028787 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/./exitable_shard1_replica1/data
[junit4] 2> 1028787 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrCore New index directory detected: old=null new=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/./exitable_shard1_replica1/data/index/
[junit4] 2> 1028787 WARN (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrCore [exitable_shard1_replica1] Solr index directory '/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/./exitable_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1028788 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/./exitable_shard1_replica1/data/index
[junit4] 2> 1028788 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7853d421 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ec30f92),segFN=segments_1,generation=1}
[junit4] 2> 1028788 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1028789 INFO (OldIndexDirectoryCleanupThreadForCore-exitable_shard1_replica1) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core exitable_shard1_replica1 in /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/./exitable_shard1_replica1/data/
[junit4] 2> 1028790 WARN (OldIndexDirectoryCleanupThreadForCore-exitable_shard1_replica1) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.DirectoryFactory /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node1/./exitable_shard1_replica1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1028787 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49aba87c
[junit4] 2> 1028793 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/./exitable_shard2_replica1/data
[junit4] 2> 1028793 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrCore New index directory detected: old=null new=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/./exitable_shard2_replica1/data/index/
[junit4] 2> 1028793 WARN (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrCore [exitable_shard2_replica1] Solr index directory '/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/./exitable_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1028794 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/./exitable_shard2_replica1/data/index
[junit4] 2> 1028795 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@cf7a44b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33d5509d),segFN=segments_1,generation=1}
[junit4] 2> 1028795 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1028796 INFO (OldIndexDirectoryCleanupThreadForCore-exitable_shard2_replica1) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core exitable_shard2_replica1 in /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/./exitable_shard2_replica1/data/
[junit4] 2> 1028796 WARN (OldIndexDirectoryCleanupThreadForCore-exitable_shard2_replica1) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.DirectoryFactory /export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_9478B3F64D931A5A-001/tempDir-001/node2/./exitable_shard2_replica1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1028798 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1028799 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1028799 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1028799 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1028799 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1028799 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1028799 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1028799 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1028799 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1028801 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1028802 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1028802 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1028803 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1028809 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1028811 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1028812 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/select,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 1028812 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1028812 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1028812 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1028812 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1028813 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1028813 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1028813 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1028813 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@cf7a44b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33d5509d),segFN=segments_1,generation=1}
[junit4] 2> 1028813 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 1028814 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5c775461[exitable_shard2_replica1] main]
[junit4] 2> 1028814 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/exitable]
[junit4] 2> 1028814 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.c.ZkStateReader path=[/collections/exitable] [configName]=[conf] specified config exists in ZooKeeper
[junit4] 2> 1028814 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf
[junit4] 2> 1028815 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1028815 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1028815 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1028815 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf/_rest_managed.json
[junit4] 2> 1028815 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1028816 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1028816 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1028816 INFO (searcherExecutor-3246-thread-1-processing-x:exitable_shard2_replica1 r:core_node2 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE n:127.0.0.1:56126_solr s:shard2 c:exitable) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.c.SolrCore [exitable_shard2_replica1] Registered new searcher Searcher@5c775461[exitable_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1028816 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1028816 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1028816 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1028817 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1538236997563318272
[junit4] 2> 1028817 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/select,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
[junit4] 2> 1028817 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1028818 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1028818 INFO (parallelCoreAdminExecutor-3244-thread-1-processing-n:127.0.0.1:33654_solr 39b18759-7d17-445d-97b6-370f950394f8119827635383920 CREATE) [n:127.0.0.1:33654_solr c:exitable s:shard1 r:core_node1 x:exitable_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1028818 INFO (parallelCoreAdminExecutor-3242-thread-1-processing-n:127.0.0.1:56126_solr 39b18759-7d17-445d-97b6-370f950394f8119827635621064 CREATE) [n:127.0.0.1:56126_solr c:exitable s:shard2 r:core_node2 x:exitable_shard2_replica1] o.a
[...truncated too long message...]
sor.run(OverseerTaskProcessor.java:189)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1032405 INFO (OverseerCollectionConfigSetProcessor-96139812186882053-127.0.0.1:56126_solr-n_0000000001) [n:127.0.0.1:56126_solr ] o.a.s.c.OverseerTaskProcessor According to ZK I (id=96139812186882053-127.0.0.1:56126_solr-n_0000000001) am no longer a leader.
[junit4] 2> 1032430 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxnFactory Ignoring exception
[junit4] 2> java.nio.channels.ClosedChannelException
[junit4] 2> at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:235)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:188)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1032431 INFO (Thread-2784) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:61389 61389
[junit4] 2> 1032432 WARN (Thread-2784) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/collections/exitable/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/overseer/queue
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2> 3 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 1032433 INFO (SUITE-CloudExitableDirectoryReaderTest-seed#[9478B3F64D931A5A]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jun 26, 2016 9:38:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> Jun 26, 2016 9:39:00 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CloudExitableDirectoryReaderTest:
[junit4] 2> 1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Jun 26, 2016 9:39:00 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> Jun 26, 2016 9:39:03 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> at java.lang.Thread.interrupt0(Native Method)
[junit4] 2> at java.lang.Thread.interrupt(Thread.java:923)
[junit4] 2> at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Lucene62, sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=sl, timezone=Asia/Gaza
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_92 (64-bit)/cpus=3,threads=3,free=133967224,total=303984640
[junit4] 2> NOTE: All tests run in this JVM: [HLLUtilTest, TestAuthorizationFramework, TestDFRSimilarityFactory, DocValuesMultiTest, WrapperMergePolicyFactoryTest, TestQueryWrapperFilter, TestShortCircuitedRequests, BadComponentTest, SharedFSAutoReplicaFailoverTest, TestSolrFieldCacheMBean, DistributedQueryComponentCustomSortTest, ClusterStateUpdateTest, CollectionStateFormat2Test, RequiredFieldsTest, DistribCursorPagingTest, SimpleCollectionCreateDeleteTest, PingRequestHandlerTest, TestSolrXml, QueryEqualityTest, TestIBSimilarityFactory, TestPartialUpdateDeduplication, HdfsUnloadDistributedZkTest, SliceStateTest, TestLockTree, HighlighterTest, DistributedSpellCheckComponentTest, BooleanFieldTest, HighlighterMaxOffsetTest, TestNamedUpdateProcessors, OutOfBoxZkACLAndCredentialsProvidersTest, TestSolrQueryParserDefaultOperatorResource, ZkCLITest, DocumentAnalysisRequestHandlerTest, BitVectorTest, TestCloudBackupRestore, JsonLoaderTest, PrimitiveFieldTypeTest, TestHdfsBackupRestoreCore, HdfsThreadLeakTest, AnalyticsMergeStrategyTest, TestMiniSolrCloudClusterSSL, TestFieldResource, TestCodecSupport, TestDefaultSearchFieldResource, TestReloadAndDeleteDocs, TestTolerantUpdateProcessorRandomCloud, SuggesterFSTTest, TestStressUserVersions, TestMinMaxOnMultiValuedField, BlockDirectoryTest, HdfsBasicDistributedZk2Test, HdfsRecoverLeaseTest, TestFunctionQuery, InfoHandlerTest, UnloadDistributedZkTest, TestHighFrequencyDictionaryFactory, TestManagedSynonymFilterFactory, ShardRoutingTest, TestFaceting, SpatialFilterTest, TestCustomSort, TestSurroundQueryParser, AssignTest, DOMUtilTest, CoreAdminRequestStatusTest, DirectoryFactoryTest, CircularListTest, FullHLLTest, CursorMarkTest, RegexBoostProcessorTest, PreAnalyzedFieldTest, TestRandomRequestDistribution, TestSolrQueryResponse, DistributedFacetPivotLongTailTest, SimpleMLTQParserTest, FastVectorHighlighterTest, TestHighlightDedupGrouping, AnalysisAfterCoreReloadTest, TestSolrConfigHandlerConcurrent, TestSolrDeletionPolicy1, TestLMDirichletSimilarityFactory, PolyFieldTest, DocExpirationUpdateProcessorFactoryTest, TestCSVLoader, CursorPagingTest, IndexSchemaTest, TestObjectReleaseTracker, TestSearcherReuse, UUIDUpdateProcessorFallbackTest, TestSearchPerf, AlternateDirectoryTest, TestUniqueKeyFieldResource, RulesTest, SuggestComponentTest, ParsingFieldUpdateProcessorsTest, CdcrRequestHandlerTest, TestConfigSets, TestSolrCLIRunExample, TestJmxIntegration, TestHashQParserPlugin, TestElisionMultitermQuery, TestAnalyzedSuggestions, UpdateParamsTest, TestPhraseSuggestions, ExternalFileFieldSortTest, DistributedFacetPivotSmallTest, ZkStateReaderTest, TestStressLucene, CloudExitableDirectoryReaderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudExitableDirectoryReaderTest -Dtests.seed=9478B3F64D931A5A -Dtests.slow=true -Dtests.locale=sl -Dtests.timezone=Asia/Gaza -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | CloudExitableDirectoryReaderTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CloudExitableDirectoryReaderTest:
[junit4] > 1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([9478B3F64D931A5A]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=8086, name=OverseerHdfsCoreFailoverThread-96139812186882053-127.0.0.1:56126_solr-n_0000000001, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] > at java.lang.Thread.interrupt0(Native Method)
[junit4] > at java.lang.Thread.interrupt(Thread.java:923)
[junit4] > at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([9478B3F64D931A5A]:0)
[junit4] Completed [171/617 (1!)] on J0 in 29.34s, 1 test, 2 errors <<< FAILURES!
[...truncated 1433 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/build.xml:740: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/build.xml:684: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/build.xml:59: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build.xml:233: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/common-build.xml:530: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/lucene/common-build.xml:1427: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/lucene/common-build.xml:984: There were test failures: 617 suites (10 ignored), 2597 tests, 2 suite-level errors, 1409 ignored (67 assumptions) [seed: 9478B3F64D931A5A]
Total time: 52 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any