You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/12/19 10:53:04 UTC

[JENKINS] Lucene-Solr-trunk-Solaris (64bit/jdk1.8.0) - Build # 271 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Solaris/271/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.util.TestSolrCLIRunExample

Error Message:
ObjectTracker found 4 object(s) that were not released!!! [TransactionLog, MockDirectoryWrapper, MDCAwareThreadPoolExecutor, MockDirectoryWrapper]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 4 object(s) that were not released!!! [TransactionLog, MockDirectoryWrapper, MDCAwareThreadPoolExecutor, MockDirectoryWrapper]
	at __randomizedtesting.SeedInfo.seed([70AB9E674BBB6F32]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.util.TestSolrCLIRunExample

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.util.TestSolrCLIRunExample:     1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.util.TestSolrCLIRunExample: 
   1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([70AB9E674BBB6F32]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.util.TestSolrCLIRunExample

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([70AB9E674BBB6F32]:0)




Build Log:
[...truncated 9638 lines...]
   [junit4] Suite: org.apache.solr.util.TestSolrCLIRunExample
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/init-core-data-001
   [junit4]   2> 620104 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testInteractiveSolrCloudExample
   [junit4]   2> 620176 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 620176 INFO  (Thread-3730) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 620176 INFO  (Thread-3730) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 620276 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.ZkTestServer start zk server on port:59366
   [junit4]   2> 620276 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 620276 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 620280 INFO  (zkCallback-689-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@58fd2453 name:ZooKeeperConnection Watcher:127.0.0.1:59366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620280 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 620280 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 620280 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 620289 INFO  (jetty-launcher-688-thread-1) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 620292 INFO  (jetty-launcher-688-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35769e61{/solr,null,AVAILABLE}
   [junit4]   2> 620292 INFO  (jetty-launcher-688-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@2a4ff203{HTTP/1.1,[http/1.1]}{127.0.0.1:40797}
   [junit4]   2> 620292 INFO  (jetty-launcher-688-thread-1) [    ] o.e.j.s.Server Started @624092ms
   [junit4]   2> 620292 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40797}
   [junit4]   2> 620293 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@659e0bfd
   [junit4]   2> 620293 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1'
   [junit4]   2> 620294 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 620294 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 620294 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 620295 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 620297 INFO  (zkCallback-690-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ec96d92 name:ZooKeeperConnection Watcher:127.0.0.1:59366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620297 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 620297 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 620297 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 620314 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1
   [junit4]   2> 620314 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 1584332256
   [junit4]   2> 620314 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1]
   [junit4]   2> 620314 WARN  (jetty-launcher-688-thread-1) [    ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/lib
   [junit4]   2> 620315 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 620316 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 620316 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 620316 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 620317 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59366/solr
   [junit4]   2> 620317 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 620317 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 620317 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 620319 INFO  (zkCallback-693-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@b968c74 name:ZooKeeperConnection Watcher:127.0.0.1:59366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620319 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 620320 INFO  (jetty-launcher-688-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 620322 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 620323 INFO  (zkCallback-694-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@177a7de5 name:ZooKeeperConnection Watcher:127.0.0.1:59366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620324 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 620326 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 620330 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 620335 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 620337 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 620340 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 620343 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 620345 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 620347 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 620349 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 620351 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 620353 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/localhost:40797_solr
   [junit4]   2> 620353 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/localhost:40797_solr
   [junit4]   2> 620357 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 620361 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 620363 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 620364 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95061131396579331-localhost:40797_solr-n_0000000000
   [junit4]   2> 620365 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader localhost:40797_solr
   [junit4]   2> 620365 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 620366 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.Overseer Overseer (id=95061131396579331-localhost:40797_solr-n_0000000000) starting
   [junit4]   2> 620369 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 620377 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 620377 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 620378 INFO  (OverseerCollectionConfigSetProcessor-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 620379 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 620394 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 620394 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 620395 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1
   [junit4]   2> 620395 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 620397 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1
   [junit4]   2> 620397 INFO  (jetty-launcher-688-thread-1) [n:localhost:40797_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 620397 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 620398 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 620399 INFO  (zkCallback-695-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70e99b4e name:ZooKeeperConnection Watcher:127.0.0.1:59366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620400 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 620400 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 620451 INFO  (qtp1545011892-6229) [n:localhost:40797_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=json} status=0 QTime=32
   [junit4]   2> 620455 INFO  (qtp1545011892-6228) [n:localhost:40797_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=json 
   [junit4]   2> 620461 INFO  (qtp1545011892-6228) [n:localhost:40797_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0 QTime=6
   [junit4]   2> 620462 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 620462 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 620463 INFO  (zkCallback-698-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@10e04723 name:ZooKeeperConnection Watcher:127.0.0.1:59366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620464 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 620464 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 620464 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 620470 INFO  (qtp1545011892-6232) [n:localhost:40797_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=list&wt=json 
   [junit4]   2> 620471 INFO  (qtp1545011892-6232) [n:localhost:40797_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=list&wt=json} status=0 QTime=0
   [junit4]   2> 620506 INFO  (qtp1545011892-6228) [n:localhost:40797_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/system params={wt=json} status=0 QTime=21
   [junit4]   2> 620509 INFO  (qtp1545011892-6231) [n:localhost:40797_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=json 
   [junit4]   2> 620512 INFO  (qtp1545011892-6231) [n:localhost:40797_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0 QTime=3
   [junit4]   2> 620513 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 620514 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 620515 INFO  (zkCallback-700-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@36e7857b name:ZooKeeperConnection Watcher:127.0.0.1:59366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620515 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 620516 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 620516 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 620527 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_cz.txt
   [junit4]   2> 620533 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/contractions_ca.txt
   [junit4]   2> 620536 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_ga.txt
   [junit4]   2> 620540 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/contractions_ga.txt
   [junit4]   2> 620543 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_ca.txt
   [junit4]   2> 620547 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_fr.txt
   [junit4]   2> 620550 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_el.txt
   [junit4]   2> 620554 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_ro.txt
   [junit4]   2> 620557 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_bg.txt
   [junit4]   2> 620561 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_lv.txt
   [junit4]   2> 620567 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/hyphenations_ga.txt
   [junit4]   2> 620571 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/contractions_fr.txt
   [junit4]   2> 620575 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stoptags_ja.txt
   [junit4]   2> 620578 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_fi.txt
   [junit4]   2> 620582 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_de.txt
   [junit4]   2> 620586 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_id.txt
   [junit4]   2> 620590 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/userdict_ja.txt
   [junit4]   2> 620598 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_no.txt
   [junit4]   2> 620601 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_ja.txt
   [junit4]   2> 620605 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_ru.txt
   [junit4]   2> 620608 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_fa.txt
   [junit4]   2> 620616 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stemdict_nl.txt
   [junit4]   2> 620621 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_hy.txt
   [junit4]   2> 620624 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_eu.txt
   [junit4]   2> 620627 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_ar.txt
   [junit4]   2> 620630 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_en.txt
   [junit4]   2> 620634 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_nl.txt
   [junit4]   2> 620638 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_da.txt
   [junit4]   2> 620641 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_tr.txt
   [junit4]   2> 620645 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_hi.txt
   [junit4]   2> 620649 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_hu.txt
   [junit4]   2> 620655 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_es.txt
   [junit4]   2> 620665 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_gl.txt
   [junit4]   2> 620669 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_sv.txt
   [junit4]   2> 620673 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_it.txt
   [junit4]   2> 620677 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/contractions_it.txt
   [junit4]   2> 620681 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_th.txt
   [junit4]   2> 620685 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/lang/stopwords_pt.txt
   [junit4]   2> 620694 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/managed-schema
   [junit4]   2> 620707 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/elevate.xml
   [junit4]   2> 620713 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/protwords.txt
   [junit4]   2> 620717 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/currency.xml
   [junit4]   2> 620723 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/params.json
   [junit4]   2> 620727 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/synonyms.txt
   [junit4]   2> 620734 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/solrconfig.xml
   [junit4]   2> 620742 INFO  (TEST-TestSolrCLIRunExample.testInteractiveSolrCloudExample-seed#[70AB9E674BBB6F32]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/testCloudExamplePrompt/stopwords.txt
   [junit4]   2> 620747 INFO  (qtp1545011892-6233) [n:localhost:40797_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=list&wt=json 
   [junit4]   2> 620747 INFO  (qtp1545011892-6233) [n:localhost:40797_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=list&wt=json} status=0 QTime=0
   [junit4]   2> 620749 INFO  (qtp1545011892-6229) [n:localhost:40797_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&maxShardsPerNode=4&collection.configName=testCloudExamplePrompt&name=testCloudExamplePrompt&action=CREATE&numShards=2&wt=json 
   [junit4]   2> 620753 INFO  (OverseerCollectionConfigSetProcessor-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>   "name":"testCloudExamplePrompt",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "collection.configName":"testCloudExamplePrompt",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 620754 INFO  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
   [junit4]   2>   "name":"testCloudExamplePrompt",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "collection.configName":"testCloudExamplePrompt",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 620757 WARN  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.OverseerCollectionMessageHandler Specified replicationFactor of 2 on collection testCloudExamplePrompt is higher than or equal to the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   2> 620758 INFO  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/testCloudExamplePrompt 
   [junit4]   2> 620758 INFO  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/testCloudExamplePrompt
   [junit4]   2> 620761 INFO  (zkCallback-694-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 620761 INFO  (zkCallback-700-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 620771 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"testCloudExamplePrompt",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "collection.configName":"testCloudExamplePrompt",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "maxShardsPerNode":"4",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 620772 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: testCloudExamplePrompt
   [junit4]   2> 620773 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/testCloudExamplePrompt/state.json
   [junit4]   2> 620871 INFO  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection testCloudExamplePrompt, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 620871 INFO  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core testCloudExamplePrompt_shard2_replica2 as part of shard shard2 of collection testCloudExamplePrompt on localhost:40797_solr
   [junit4]   2> 620872 INFO  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core testCloudExamplePrompt_shard1_replica1 as part of shard shard1 of collection testCloudExamplePrompt on localhost:40797_solr
   [junit4]   2> 620878 INFO  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core testCloudExamplePrompt_shard1_replica2 as part of shard shard1 of collection testCloudExamplePrompt on localhost:40797_solr
   [junit4]   2> 620880 INFO  (qtp1545011892-6232) [n:localhost:40797_solr    ] o.a.s.h.a.CoreAdminHandler core create command qt=/admin/cores&collection.configName=testCloudExamplePrompt&name=testCloudExamplePrompt_shard2_replica2&action=CREATE&numShards=2&collection=testCloudExamplePrompt&shard=shard2&wt=javabin&version=2
   [junit4]   2> 620880 INFO  (qtp1545011892-6230) [n:localhost:40797_solr    ] o.a.s.h.a.CoreAdminHandler core create command qt=/admin/cores&collection.configName=testCloudExamplePrompt&name=testCloudExamplePrompt_shard1_replica1&action=CREATE&numShards=2&collection=testCloudExamplePrompt&shard=shard1&wt=javabin&version=2
   [junit4]   2> 620880 INFO  (qtp1545011892-6232) [n:localhost:40797_solr    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=testCloudExamplePrompt_shard2_replica2, collection.configName=testCloudExamplePrompt, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=testCloudExamplePrompt, numShards=2, dataDir=data/, shard=shard2}
   [junit4]   2> 620880 INFO  (qtp1545011892-6230) [n:localhost:40797_solr    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=testCloudExamplePrompt_shard1_replica1, collection.configName=testCloudExamplePrompt, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=testCloudExamplePrompt, numShards=2, dataDir=data/, shard=shard1}
   [junit4]   2> 620882 INFO  (OverseerThreadFactory-1930-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core testCloudExamplePrompt_shard2_replica1 as part of shard shard2 of collection testCloudExamplePrompt on localhost:40797_solr
   [junit4]   2> 620883 INFO  (qtp1545011892-6233) [n:localhost:40797_solr    ] o.a.s.h.a.CoreAdminHandler core create command qt=/admin/cores&collection.configName=testCloudExamplePrompt&name=testCloudExamplePrompt_shard1_replica2&action=CREATE&numShards=2&collection=testCloudExamplePrompt&shard=shard1&wt=javabin&version=2
   [junit4]   2> 620884 INFO  (qtp1545011892-6231) [n:localhost:40797_solr    ] o.a.s.h.a.CoreAdminHandler core create command qt=/admin/cores&collection.configName=testCloudExamplePrompt&name=testCloudExamplePrompt_shard2_replica1&action=CREATE&numShards=2&collection=testCloudExamplePrompt&shard=shard2&wt=javabin&version=2
   [junit4]   2> 620885 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 620885 INFO  (qtp1545011892-6233) [n:localhost:40797_solr    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=testCloudExamplePrompt_shard1_replica2, collection.configName=testCloudExamplePrompt, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=testCloudExamplePrompt, numShards=2, dataDir=data/, shard=shard1}
   [junit4]   2> 620885 INFO  (qtp1545011892-6231) [n:localhost:40797_solr    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=testCloudExamplePrompt_shard2_replica1, collection.configName=testCloudExamplePrompt, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=testCloudExamplePrompt, numShards=2, dataDir=data/, shard=shard2}
   [junit4]   2> 620885 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 620888 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.ZkController Registering watch for collection testCloudExamplePrompt
   [junit4]   2> 620888 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.c.ZkStateReader addZkWatch testCloudExamplePrompt
   [junit4]   2> 620888 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.ZkController Registering watch for collection testCloudExamplePrompt
   [junit4]   2> 620889 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 620889 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 620889 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 620889 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.c.ZkStateReader Add data for testCloudExamplePrompt ver 0 
   [junit4]   2> 620889 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 620889 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"testCloudExamplePrompt_shard2_replica2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://localhost:40797/solr",
   [junit4]   2>   "node_name":"localhost:40797_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"testCloudExamplePrompt",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 620890 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"testCloudExamplePrompt_shard2_replica2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://localhost:40797/solr",
   [junit4]   2>   "node_name":"localhost:40797_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"testCloudExamplePrompt",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 620891 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.ZkController Registering watch for collection testCloudExamplePrompt
   [junit4]   2> 620891 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 620891 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.ZkController Registering watch for collection testCloudExamplePrompt
   [junit4]   2> 620891 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 620894 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"testCloudExamplePrompt_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://localhost:40797/solr",
   [junit4]   2>   "node_name":"localhost:40797_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"testCloudExamplePrompt",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 620894 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"testCloudExamplePrompt_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://localhost:40797/solr",
   [junit4]   2>   "node_name":"localhost:40797_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"testCloudExamplePrompt",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 620898 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"testCloudExamplePrompt_shard1_replica2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://localhost:40797/solr",
   [junit4]   2>   "node_name":"localhost:40797_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"testCloudExamplePrompt",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 620898 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"testCloudExamplePrompt_shard1_replica2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://localhost:40797/solr",
   [junit4]   2>   "node_name":"localhost:40797_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"testCloudExamplePrompt",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 620900 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"testCloudExamplePrompt_shard2_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://localhost:40797/solr",
   [junit4]   2>   "node_name":"localhost:40797_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"testCloudExamplePrompt",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 620901 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"testCloudExamplePrompt_shard2_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://localhost:40797/solr",
   [junit4]   2>   "node_name":"localhost:40797_solr",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"testCloudExamplePrompt",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 621004 INFO  (OverseerStateUpdate-95061131396579331-localhost:40797_solr-n_0000000000) [n:localhost:40797_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/testCloudExamplePrompt/state.json version: 0
   [junit4]   2> 621005 INFO  (zkCallback-694-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCloudExamplePrompt/state.json for collection testCloudExamplePrompt has occurred - updating... (live nodes size: 1)
   [junit4]   2> 621005 INFO  (zkCallback-694-thread-1-processing-n:localhost:40797_solr) [n:localhost:40797_solr    ] o.a.s.c.c.ZkStateReader Updating data for testCloudExamplePrompt from 0 to 1 
   [junit4]   2> 621890 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.ZkController waiting to find shard id in clusterstate for testCloudExamplePrompt_shard2_replica2
   [junit4]   2> 621890 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.ZkController Check for collection zkNode:testCloudExamplePrompt
   [junit4]   2> 621890 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 621890 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.c.ZkStateReader Load collection config from:/collections/testCloudExamplePrompt
   [junit4]   2> 621891 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.ZkController waiting to find shard id in clusterstate for testCloudExamplePrompt_shard1_replica1
   [junit4]   2> 621891 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.ZkController Check for collection zkNode:testCloudExamplePrompt
   [junit4]   2> 621891 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 621891 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/testCloudExamplePrompt
   [junit4]   2> 621892 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.c.ZkStateReader path=/collections/testCloudExamplePrompt configName=testCloudExamplePrompt specified config exists in ZooKeeper
   [junit4]   2> 621892 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2'
   [junit4]   2> 621892 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.ZkController waiting to find shard id in clusterstate for testCloudExamplePrompt_shard1_replica2
   [junit4]   2> 621892 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.ZkController Check for collection zkNode:testCloudExamplePrompt
   [junit4]   2> 621892 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.ZkController waiting to find shard id in clusterstate for testCloudExamplePrompt_shard2_replica1
   [junit4]   2> 621892 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 621892 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.ZkController Check for collection zkNode:testCloudExamplePrompt
   [junit4]   2> 621892 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 621893 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 621893 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.c.ZkStateReader Load collection config from:/collections/testCloudExamplePrompt
   [junit4]   2> 621893 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 621893 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/testCloudExamplePrompt
   [junit4]   2> 621893 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.c.ZkStateReader path=/collections/testCloudExamplePrompt configName=testCloudExamplePrompt specified config exists in ZooKeeper
   [junit4]   2> 621893 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1'
   [junit4]   2> 621893 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 621893 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 621894 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.c.ZkStateReader path=/collections/testCloudExamplePrompt configName=testCloudExamplePrompt specified config exists in ZooKeeper
   [junit4]   2> 621895 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2'
   [junit4]   2> 621895 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 621895 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 621895 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 621895 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.c.ZkStateReader path=/collections/testCloudExamplePrompt configName=testCloudExamplePrompt specified config exists in ZooKeeper
   [junit4]   2> 621895 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1'
   [junit4]   2> 621896 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 621896 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 621896 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 621897 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 621901 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 621906 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 621906 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 621906 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig current version of requestparams : 0
   [junit4]   2> 621906 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 621906 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 621906 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig current version of requestparams : 0
   [junit4]   2> 621907 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Adding specified lib dirs to ClassLoader
   [junit4]   2> 621907 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Adding specified lib dirs to ClassLoader
   [junit4]   2> 621908 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 621908 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 621908 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig current version of requestparams : 0
   [junit4]   2> 621909 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Adding specified lib dirs to ClassLoader
   [junit4]   2> 621909 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 621943 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 621943 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig current version of requestparams : 0
   [junit4]   2> 621944 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Adding specified lib dirs to ClassLoader
   [junit4]   2> 621944 WARN  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../contrib/extraction/lib
   [junit4]   2> 621944 WARN  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../contrib/extraction/lib
   [junit4]   2> 621945 WARN  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../dist
   [junit4]   2> 621946 WARN  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../contrib/extraction/lib
   [junit4]   2> 621946 WARN  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../contrib/clustering/lib
   [junit4]   2> 621945 WARN  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../dist
   [junit4]   2> 621946 WARN  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../dist
   [junit4]   2> 621946 WARN  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../contrib/clustering/lib
   [junit4]   2> 621946 WARN  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../dist
   [junit4]   2> 621946 WARN  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../contrib/langid/lib
   [junit4]   2> 621947 WARN  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../contrib/langid/lib
   [junit4]   2> 621947 WARN  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../dist
   [junit4]   2> 621946 WARN  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../dist
   [junit4]   2> 621947 WARN  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../contrib/clustering/lib
   [junit4]   2> 621947 WARN  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../contrib/velocity/lib
   [junit4]   2> 621947 WARN  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../dist
   [junit4]   2> 621947 WARN  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica1/../../../../dist
   [junit4]   2> 621948 WARN  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../contrib/langid/lib
   [junit4]   2> 621948 WARN  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../dist
   [junit4]   2> 621948 WARN  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../contrib/velocity/lib
   [junit4]   2> 621948 WARN  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica1/../../../../dist
   [junit4]   2> 621950 WARN  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../contrib/extraction/lib
   [junit4]   2> 621951 WARN  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../dist
   [junit4]   2> 621951 WARN  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../contrib/clustering/lib
   [junit4]   2> 621951 WARN  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../dist
   [junit4]   2> 621952 WARN  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../contrib/langid/lib
   [junit4]   2> 621952 WARN  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../dist
   [junit4]   2> 621952 WARN  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../contrib/velocity/lib
   [junit4]   2> 621953 WARN  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard2_replica2/../../../../dist
   [junit4]   2> 621953 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 621947 WARN  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../dist
   [junit4]   2> 621966 WARN  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../contrib/velocity/lib
   [junit4]   2> 621966 WARN  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J1/temp/solr.util.TestSolrCLIRunExample_70AB9E674BBB6F32-001/tempDir-002/node1/testCloudExamplePrompt_shard1_replica2/../../../../dist
   [junit4]   2> 621968 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 621975 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 621979 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 622022 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 622046 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 622046 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 622048 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 622052 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.s.IndexSchema [testCloudExamplePrompt_shard1_replica2] Schema name=example-data-driven-schema
   [junit4]   2> 622193 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.s.IndexSchema [testCloudExamplePrompt_shard1_replica1] Schema name=example-data-driven-schema
   [junit4]   2> 622287 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica1] o.a.s.s.IndexSchema [testCloudExamplePrompt_shard2_replica1] Schema name=example-data-driven-schema
   [junit4]   2> 622379 INFO  (qtp1545011892-6232) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testCloudExamplePrompt_shard2_replica2] o.a.s.s.IndexSchema [testCloudExamplePrompt_shard2_replica2] Schema name=example-data-driven-schema
   [junit4]   2> 623005 INFO  (qtp1545011892-6233) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica2] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 623008 INFO  (qtp1545011892-6230) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard1  x:testCloudExamplePrompt_shard1_replica1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 623037 INFO  (qtp1545011892-6231) [n:localhost:40797_solr c:testCloudExamplePrompt s:shard2  x:testClo

[...truncated too long message...]

	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:517)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> Dec 19, 2015 9:38:11 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Dec 19, 2015 9:38:31 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.util.TestSolrCLIRunExample: 
   [junit4]   2>    1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Dec 19, 2015 9:38:31 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]
   [junit4]   2> Dec 19, 2015 9:38:34 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ar_IQ, timezone=America/Creston
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=3,threads=2,free=126984528,total=267235328
   [junit4]   2> NOTE: All tests run in this JVM: [TestExactStatsCache, TestDistribIDF, SignatureUpdateProcessorFactoryTest, ResponseLogComponentTest, TestAtomicUpdateErrorCases, FullHLLTest, ZkStateWriterTest, DistribDocExpirationUpdateProcessorTest, LukeRequestHandlerTest, TestFieldTypeCollectionResource, OutputWriterTest, DistributedQueueTest, TestPHPSerializedResponseWriter, TestReversedWildcardFilterFactory, ConvertedLegacyTest, DirectSolrConnectionTest, TestSolrQueryParser, TestJoin, TestSmileRequest, CdcrUpdateLogTest, CollectionsAPIDistributedZkTest, HdfsRestartWhileUpdatingTest, TestSolrDeletionPolicy2, LoggingHandlerTest, CacheHeaderTest, TestMiniSolrCloudClusterBase, OpenCloseCoreStressTest, HdfsBasicDistributedZk2Test, HLLUtilTest, TestRangeQuery, ShardRoutingCustomTest, DistributedFacetPivotWhiteBoxTest, TestAnalyzeInfixSuggestions, TestManagedStopFilterFactory, ResponseHeaderTest, TestFiltering, CopyFieldTest, ActionThrottleTest, TestUtils, TestRequestForwarding, JavabinLoaderTest, TestFileDictionaryLookup, TestImplicitCoreProperties, TestRecoveryHdfs, TestAuthenticationFramework, SecurityConfHandlerTest, TestSolrConfigHandler, BasicZkTest, OpenExchangeRatesOrgProviderTest, TestSearcherReuse, TestSolrCLIRunExample]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCLIRunExample -Dtests.seed=70AB9E674BBB6F32 -Dtests.slow=true -Dtests.locale=ar_IQ -Dtests.timezone=America/Creston -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | TestSolrCLIRunExample (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ObjectTracker found 4 object(s) that were not released!!! [TransactionLog, MockDirectoryWrapper, MDCAwareThreadPoolExecutor, MockDirectoryWrapper]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([70AB9E674BBB6F32]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:229)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.util.TestSolrCLIRunExample: 
   [junit4]    >    1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([70AB9E674BBB6F32]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=6354, name=searcherExecutor-1966-thread-1, state=WAITING, group=TGRP-TestSolrCLIRunExample]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([70AB9E674BBB6F32]:0)
   [junit4] Completed [95/568 (1!)] on J1 in 162.78s, 3 tests, 1 failure, 2 errors, 1 skipped <<< FAILURES!

[...truncated 1486 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:784: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:728: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:59: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build.xml:233: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/common-build.xml:516: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:1436: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:991: There were test failures: 568 suites (8 ignored), 2263 tests, 3 suite-level errors, 1357 ignored (63 assumptions) [seed: 70AB9E674BBB6F32]

Total time: 51 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Solaris (64bit/jdk1.8.0) - Build # 272 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Solaris/272/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.StressHdfsTest.test

Error Message:
Could not load collection from ZK:delete_data_dir

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK:delete_data_dir
	at __randomizedtesting.SeedInfo.seed([2B14B739BCA76345:A34088E3125B0EBD]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1018)
	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:551)
	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:190)
	at org.apache.solr.common.cloud.ClusterState.hasCollection(ClusterState.java:120)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1111)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:834)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
	at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:485)
	at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:464)
	at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:197)
	at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:100)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/delete_data_dir/state.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1031)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1016)
	... 52 more




Build Log:
[...truncated 9401 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.StressHdfsTest
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/init-core-data-001
   [junit4]   2> 262071 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /uj_uk/qx
   [junit4]   2> 262798 WARN  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 263601 WARN  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 263812 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 263823 WARN  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 263925 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 263986 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_solaris.vm_43242_hdfs____.cs71nh/webapp
   [junit4]   2> 264130 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 264754 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@solaris-vm:43242
   [junit4]   2> 265611 WARN  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 265617 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 265630 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_solaris.vm_45068_datanode____.aivhc/webapp
   [junit4]   2> 265729 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 266225 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@solaris-vm:45068
   [junit4]   2> 266367 WARN  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 266377 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 266393 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log Extract jar:file:/export/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_solaris.vm_35961_datanode____ml7ye9/webapp
   [junit4]   2> 266493 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 266914 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@solaris-vm:35961
   [junit4]   2> 267605 ERROR (Finalizer) [    ] o.a.s.u.ConcurrentLFUCache ConcurrentLFUCache was not destroyed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
   [junit4]   2> 267860 INFO  (IPC Server handler 7 on 42461) [    ] BlockStateChange BLOCK* processReport: from storage DS-8359f721-8910-4ad4-a65b-c519f53e639c node DatanodeRegistration(127.0.0.1, datanodeUuid=6177e8e8-e16b-43f8-a198-0770f50e93bb, infoPort=35961, ipcPort=52728, storageInfo=lv=-56;cid=testClusterID;nsid=602613016;c=0), blocks: 0, hasStaleStorages: true, processing time: 3 msecs
   [junit4]   2> 267860 INFO  (IPC Server handler 8 on 42461) [    ] BlockStateChange BLOCK* processReport: from storage DS-967f68a1-f8a0-4dd0-9eae-ee57cd32a315 node DatanodeRegistration(127.0.0.1, datanodeUuid=82e47cdb-dfee-4bce-a05a-d09141f77cd7, infoPort=45068, ipcPort=40852, storageInfo=lv=-56;cid=testClusterID;nsid=602613016;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 267860 INFO  (IPC Server handler 7 on 42461) [    ] BlockStateChange BLOCK* processReport: from storage DS-60e17d19-6209-4a81-8bb1-6f713ee7ec2b node DatanodeRegistration(127.0.0.1, datanodeUuid=6177e8e8-e16b-43f8-a198-0770f50e93bb, infoPort=35961, ipcPort=52728, storageInfo=lv=-56;cid=testClusterID;nsid=602613016;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 267876 INFO  (IPC Server handler 8 on 42461) [    ] BlockStateChange BLOCK* processReport: from storage DS-0ef76614-96bf-44f7-96a0-62514ed10b8b node DatanodeRegistration(127.0.0.1, datanodeUuid=82e47cdb-dfee-4bce-a05a-d09141f77cd7, infoPort=45068, ipcPort=40852, storageInfo=lv=-56;cid=testClusterID;nsid=602613016;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 268404 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 268405 INFO  (Thread-825) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 268405 INFO  (Thread-825) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 268505 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.ZkTestServer start zk server on port:40000
   [junit4]   2> 268505 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 268506 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 268511 INFO  (zkCallback-292-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@687b2fe0 name:ZooKeeperConnection Watcher:127.0.0.1:40000 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 268511 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 268511 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 268511 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 268515 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 268516 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 268519 INFO  (zkCallback-293-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e11a87d name:ZooKeeperConnection Watcher:127.0.0.1:40000/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 268519 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 268519 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 268519 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 268523 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 268525 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 268527 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 268530 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 268530 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 268534 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 268534 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 268537 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 268537 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 268540 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 268540 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 268543 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 268543 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 268546 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 268546 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 268549 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 268549 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 268552 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 268552 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 268555 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 268556 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 268560 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 268560 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 268563 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 268563 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 268835 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/cores/collection1
   [junit4]   2> 268837 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 268840 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a5c3006{/uj_uk/qx,null,AVAILABLE}
   [junit4]   2> 268841 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.e.j.s.ServerConnector Started ServerConnector@73300a01{HTTP/1.1,[http/1.1]}{127.0.0.1:34080}
   [junit4]   2> 268841 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.e.j.s.Server Started @272350ms
   [junit4]   2> 268841 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://solaris-vm:42461/hdfs__solaris-vm_42461__export_home_jenkins_workspace_Lucene-Solr-trunk-Solaris_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001_tempDir-002_control_data, hostContext=/uj_uk/qx, hostPort=34080, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/cores}
   [junit4]   2> 268842 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@659e0bfd
   [junit4]   2> 268842 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001'
   [junit4]   2> 268842 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 268843 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 268843 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 268844 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 268848 INFO  (zkCallback-294-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3e759af8 name:ZooKeeperConnection Watcher:127.0.0.1:40000/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 268848 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 268849 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 268851 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 268851 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/solr.xml
   [junit4]   2> 268858 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/cores
   [junit4]   2> 268858 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.CoreContainer New CoreContainer 1571175877
   [junit4]   2> 268858 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001]
   [junit4]   2> 268859 WARN  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/lib
   [junit4]   2> 268859 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 268861 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 268861 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 268861 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 268861 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40000/solr
   [junit4]   2> 268861 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 268861 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 268862 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 268864 INFO  (zkCallback-297-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5eb876e0 name:ZooKeeperConnection Watcher:127.0.0.1:40000 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 268865 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 268865 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 268868 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 268870 INFO  (zkCallback-298-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4697970c name:ZooKeeperConnection Watcher:127.0.0.1:40000/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 268870 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 268872 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 268875 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 268881 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 268885 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 268888 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 268892 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 268895 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 268897 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 268900 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 268901 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34080_uj_uk%2Fqx
   [junit4]   2> 268902 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:34080_uj_uk%2Fqx
   [junit4]   2> 268905 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 268908 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 268910 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 268911 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000
   [junit4]   2> 268912 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34080_uj_uk%2Fqx
   [junit4]   2> 268912 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 268914 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.Overseer Overseer (id=95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) starting
   [junit4]   2> 268917 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 268928 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 268929 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 268929 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 268932 INFO  (OverseerCollectionConfigSetProcessor-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 268950 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 268950 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 268951 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/cores
   [junit4]   2> 268952 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 268952 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/cores/collection1
   [junit4]   2> 268952 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 268955 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0
   [junit4]   2> 268955 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 268955 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 268955 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 268958 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:34080/uj_uk/qx",
   [junit4]   2>   "node_name":"127.0.0.1:34080_uj_uk%2Fqx",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 268958 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 268959 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:34080/uj_uk/qx",
   [junit4]   2>   "node_name":"127.0.0.1:34080_uj_uk%2Fqx",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 268959 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 268960 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 268962 INFO  (zkCallback-298-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 269960 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 269960 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 269961 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 269961 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 269962 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 269962 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/cores/collection1'
   [junit4]   2> 269962 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 269962 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 269964 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 269971 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 269978 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 270001 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 270011 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 270102 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 270108 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 270108 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 270123 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 270127 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 270130 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 270131 WARN  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 270132 WARN  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 270132 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 270133 WARN  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 270133 WARN  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 270135 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0
   [junit4]   2> 270135 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 270135 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 270151 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://solaris-vm:42461/solr_hdfs_home
   [junit4]   2> 270151 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 270152 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/control-001/cores/collection1], dataDir=[hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 270152 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@75cd13fb
   [junit4]   2> 270152 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 270263 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 270276 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 270303 WARN  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 270303 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 270312 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 270312 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 270312 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 272349 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 272349 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 272350 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3286810720604001]
   [junit4]   2> 272685 INFO  (IPC Server handler 9 on 42461) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33553 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-967f68a1-f8a0-4dd0-9eae-ee57cd32a315:NORMAL:127.0.0.1:33553|RBW], ReplicaUnderConstruction[[DISK]DS-8359f721-8910-4ad4-a65b-c519f53e639c:NORMAL:127.0.0.1:42870|RBW]]} size 71
   [junit4]   2> 272686 INFO  (IPC Server handler 7 on 42461) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42870 is added to blk_1073741825_1001 size 71
   [junit4]   2> 273102 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@36db0ca3); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 273103 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 273108 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 273115 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 273115 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 273116 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 273116 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 273116 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 273116 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 273117 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 273117 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 273117 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 273117 WARN  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 273128 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 273131 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 273133 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 273134 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 273139 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 273140 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 273146 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 273146 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 273164 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 273164 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 273166 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=94.59375, floorSegmentMB=0.3681640625, forceMergeDeletesPctAllowed=8.40068394161952, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24204807476475265
   [junit4]   2> 273274 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://solaris-vm:42461/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@36db0ca3); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 273274 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 273274 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@66c45e1b[collection1] main
   [junit4]   2> 273274 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 273276 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 273276 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 273277 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 273277 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 273277 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 273278 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 273278 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 273278 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 273280 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 273283 INFO  (searcherExecutor-690-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@66c45e1b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 273283 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 273283 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 273283 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 273283 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1521012445139697664
   [junit4]   2> 273283 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1521012445139697664
   [junit4]   2> 273283 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 273284 INFO  (coreLoadExecutor-689-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 273285 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:34080/uj_uk/qx collection:control_collection shard:shard1
   [junit4]   2> 273286 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 273293 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95063277501677572-core_node1-n_0000000000
   [junit4]   2> 273293 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 273296 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 273296 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 273296 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34080/uj_uk/qx/collection1/
   [junit4]   2> 273296 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 273296 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:34080/uj_uk/qx/collection1/ has no replicas
   [junit4]   2> 273297 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 273298 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 273299 INFO  (zkCallback-298-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 273303 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 273307 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34080/uj_uk/qx/collection1/ shard1
   [junit4]   2> 273308 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:34080/uj_uk/qx",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 273412 INFO  (zkCallback-298-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 273458 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:34080/uj_uk/qx/collection1/ and leader is http://127.0.0.1:34080/uj_uk/qx/collection1/
   [junit4]   2> 273459 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34080/uj_uk/qx
   [junit4]   2> 273459 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 273459 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 273459 INFO  (coreZkRegister-683-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:34080_uj_uk%2Fqx c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 273462 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:34080/uj_uk/qx",
   [junit4]   2>   "node_name":"127.0.0.1:34080_uj_uk%2Fqx",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 273463 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:34080/uj_uk/qx",
   [junit4]   2>   "node_name":"127.0.0.1:34080_uj_uk%2Fqx",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 273467 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 273468 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 273470 INFO  (zkCallback-300-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@15b3e1f0 name:ZooKeeperConnection Watcher:127.0.0.1:40000/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 273470 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 273470 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 273470 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 273474 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 273568 INFO  (zkCallback-300-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 273568 INFO  (zkCallback-298-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 273619 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001/cores/collection1
   [junit4]   2> 273620 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001
   [junit4]   2> 273621 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 273625 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@98368b6{/uj_uk/qx,null,AVAILABLE}
   [junit4]   2> 273625 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.e.j.s.ServerConnector Started ServerConnector@7d2b7424{HTTP/1.1,[http/1.1]}{127.0.0.1:60176}
   [junit4]   2> 273625 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.e.j.s.Server Started @277136ms
   [junit4]   2> 273626 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://solaris-vm:42461/hdfs__solaris-vm_42461__export_home_jenkins_workspace_Lucene-Solr-trunk-Solaris_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/uj_uk/qx, hostPort=60176, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001/cores}
   [junit4]   2> 273626 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@659e0bfd
   [junit4]   2> 273626 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001'
   [junit4]   2> 273627 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 273627 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 273627 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 273627 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 273631 INFO  (zkCallback-301-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f7e4dc9 name:ZooKeeperConnection Watcher:127.0.0.1:40000/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 273631 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 273631 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 273633 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 273634 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001/solr.xml
   [junit4]   2> 273652 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001/cores
   [junit4]   2> 273652 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.CoreContainer New CoreContainer 291712822
   [junit4]   2> 273652 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001]
   [junit4]   2> 273652 WARN  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001/lib
   [junit4]   2> 273653 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 273655 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 273656 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 273656 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 273656 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40000/solr
   [junit4]   2> 273656 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 273656 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 273656 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 273661 INFO  (zkCallback-304-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@686e7c67 name:ZooKeeperConnection Watcher:127.0.0.1:40000 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 273662 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 273662 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 273665 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 273667 INFO  (zkCallback-305-thread-1-processing-n:127.0.0.1:60176_uj_uk%2Fqx) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@23145a53 name:ZooKeeperConnection Watcher:127.0.0.1:40000/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 273668 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 273677 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 274687 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60176_uj_uk%2Fqx
   [junit4]   2> 274687 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60176_uj_uk%2Fqx
   [junit4]   2> 274689 INFO  (zkCallback-300-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 274689 INFO  (zkCallback-305-thread-1-processing-n:127.0.0.1:60176_uj_uk%2Fqx) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 274689 INFO  (zkCallback-298-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 274692 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 274693 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95063277501677576-127.0.0.1:60176_uj_uk%2Fqx-n_0000000001
   [junit4]   2> 274694 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000 to know if I could be the leader
   [junit4]   2> 274702 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 274702 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 274703 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001/cores
   [junit4]   2> 274704 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 274704 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/../../../../../../../../../../export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001/shard-1-001/cores/collection1
   [junit4]   2> 274704 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 274705 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0
   [junit4]   2> 274705 INFO  (TEST-StressHdfsTest.test-seed#[2B14B739BCA76345]) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 274706 INFO  (coreLoadExecutor-700-thread-1-processing-n:127.0.0.1:60176_uj_uk%2Fqx) [n:127.0.0.1:60176_uj_uk%2Fqx c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 274706 INFO  (coreLoadExecutor-700-thread-1-processing-n:127.0.0.1:60176_uj_uk%2Fqx) [n:127.0.0.1:60176_uj_uk%2Fqx c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 274710 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:60176/uj_uk/qx",
   [junit4]   2>   "node_name":"127.0.0.1:60176_uj_uk%2Fqx",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 4
   [junit4]   2> 274710 INFO  (coreLoadExecutor-700-thread-1-processing-n:127.0.0.1:60176_uj_uk%2Fqx) [n:127.0.0.1:60176_uj_uk%2Fqx c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 274710 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:60176/uj_uk/qx",
   [junit4]   2>   "node_name":"127.0.0.1:60176_uj_uk%2Fqx",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 274710 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 274711 INFO  (OverseerStateUpdate-95063277501677572-127.0.0.1:34080_uj_uk%2Fqx-n_0000000000) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 274815 INFO  (zkCallback-300-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 274815 INFO  (zkCallback-298-thread-1-processing-n:127.0.0.1:34080_uj_uk%2Fqx) [n:127.0.0.1:34080_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 274815 INFO  (zkCallback-305-thread-1-processing-n:127.0.0.1:60176_uj_uk%2Fqx) [n:127.0.0.1:60176_uj_uk%2Fqx    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 275717 INFO  (coreLoadExecutor-700-thread-1-processing-n:127.0.0.1:60176_uj_uk%2Fqx) [n:127.0.0.1:60176_uj_uk%2Fqx c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 275717 INFO  (coreLoadExecutor-700-thread-1-processing-n:127.0.0.1:60176_uj_uk%2Fqx) [n:127.0.0.1:60176_uj_uk%2Fqx c:collection1   x:collection1] o.a.s.c.ZkController C

[...truncated too long message...]

de Uuid 82e47cdb-dfee-4bce-a05a-d09141f77cd7) service to solaris-vm/127.0.0.1:42461
   [junit4]   2> 340719 WARN  (org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor@36d4c9b2) [    ] o.a.h.h.s.b.DecommissionManager Monitor interrupted: java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 340825 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [n:127.0.0.1:39313_uj_uk%2Fqx c:delete_data_dir s:shard4 r:core_node2 x:delete_data_dir_shard4_replica1] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@solaris-vm:0
   [junit4]   2> 340930 ERROR (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [n:127.0.0.1:39313_uj_uk%2Fqx c:delete_data_dir s:shard4 r:core_node2 x:delete_data_dir_shard4_replica1] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
   [junit4]   2> java.lang.reflect.InvocationTargetException
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.StressHdfsTest.teardownClass(StressHdfsTest.java:74)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 54 more
   [junit4]   2> 340940 INFO  (SUITE-StressHdfsTest-seed#[2B14B739BCA76345]-worker) [n:127.0.0.1:39313_uj_uk%2Fqx c:delete_data_dir s:shard4 r:core_node2 x:delete_data_dir_shard4_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.StressHdfsTest_2B14B739BCA76345-001
   [junit4]   2> Dec 19, 2015 6:42:51 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60), sim=ClassicSimilarity, locale=de_AT, timezone=Indian/Reunion
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=3,threads=6,free=172642624,total=360710144
   [junit4]   2> NOTE: All tests run in this JVM: [TestManagedSynonymFilterFactory, TestNamedUpdateProcessors, TestManagedSchemaFieldResource, CursorMarkTest, RegexBoostProcessorTest, AliasIntegrationTest, RequestLoggingTest, TestCloudInspectUtil, TestTrackingShardHandlerFactory, TestCloudSchemaless, TestLFUCache, TestLRUStatsCache, HdfsBasicDistributedZkTest, OutOfBoxZkACLAndCredentialsProvidersTest, AsyncCallRequestStatusResponseTest, TestSimpleQParserPlugin, StressHdfsTest]
   [junit4] Completed [37/568 (1!)] on J0 in 88.49s, 1 test, 1 error <<< FAILURES!

[...truncated 1736 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:784: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:728: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/build.xml:59: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/build.xml:233: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/solr/common-build.xml:516: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:1436: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-trunk-Solaris/lucene/common-build.xml:991: There were test failures: 568 suites (8 ignored), 2263 tests, 1 error, 85 ignored (70 assumptions) [seed: 2B14B739BCA76345]

Total time: 77 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any