You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/05/07 19:40:57 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2275 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2275/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.TestZkChroot.testChrootBootstrap

Error Message:
Captured an uncaught exception in thread: Thread[id=8515, name=coreZkRegister-3856-thread-1, state=RUNNABLE, group=TGRP-TestZkChroot]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=8515, name=coreZkRegister-3856-thread-1, state=RUNNABLE, group=TGRP-TestZkChroot]
	at __randomizedtesting.SeedInfo.seed([1F2E2ACAFB069488:392FB8EF2D811832]:0)
Caused by: java.lang.AssertionError: 1
	at __randomizedtesting.SeedInfo.seed([1F2E2ACAFB069488]:0)
	at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:201)
	at org.apache.solr.core.SolrCore.close(SolrCore.java:1235)
	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:326)
	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:198)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348)
	at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1050)
	at org.apache.solr.cloud.ZkController.register(ZkController.java:863)
	at org.apache.solr.cloud.ZkController.register(ZkController.java:817)
	at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:185)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestZkChroot

Error Message:
ERROR: SolrIndexSearcher opens=3 closes=2

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=3 closes=2
	at __randomizedtesting.SeedInfo.seed([1F2E2ACAFB069488]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:496)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:232)
	at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10142 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestZkChroot
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/init-core-data-001
   [junit4]   2> 1597385 T8485 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1597387 T8485 oas.SolrTestCaseJ4.setUp ###Starting testNoBootstrapConf
   [junit4]   2> 1597388 T8485 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1597389 T8486 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1597389 T8486 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1597490 T8485 oasc.ZkTestServer.run start zk server on port:56425
   [junit4]   2> 1597758 T8485 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1597759 T8485 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1597768 T8493 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d86f1a2 name:ZooKeeperConnection Watcher:127.0.0.1:56425 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1597768 T8485 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1597769 T8485 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1597771 T8485 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-001/'
   [junit4]   2> 1597804 T8485 oasc.SolrXmlConfig.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-001/solr.xml
   [junit4]   2> 1597816 T8485 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-001
   [junit4]   2> 1597816 T8485 oasc.CoreContainer.<init> New CoreContainer 1270560569
   [junit4]   2> 1597816 T8485 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-001/]
   [junit4]   2> 1597816 T8485 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-001/lib
   [junit4]   2> 1597817 T8485 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-001/lib).
   [junit4]   2> 1597827 T8485 oashc.HttpShardHandlerFactory.init created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1597830 T8485 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1597831 T8485 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1597832 T8485 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1597832 T8485 oasc.CoreContainer.load Node Name: 
   [junit4]   2> 1597832 T8485 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56425/foo/bar2
   [junit4]   2> 1597833 T8485 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1597833 T8485 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1597834 T8485 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1597838 T8496 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76b13031 name:ZooKeeperConnection Watcher:127.0.0.1:56425 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1597839 T8485 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1597839 T8485 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1597844 T8485 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1270560569
   [junit4]   2> 1597847 T8485 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56425 56425
   [junit4]   2> 1597938 T8486 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56425 56425
   [junit4]   2> 1598994 T8485 oas.SolrTestCaseJ4.tearDown ###Ending testNoBootstrapConf
   [junit4]   2> 1598997 T8485 oas.SolrTestCaseJ4.setUp ###Starting testChrootBootstrap
   [junit4]   2> 1598998 T8485 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1598999 T8497 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1598999 T8497 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1599100 T8485 oasc.ZkTestServer.run start zk server on port:56434
   [junit4]   2> 1599478 T8485 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/'
   [junit4]   2> 1599512 T8485 oasc.SolrXmlConfig.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/solr.xml
   [junit4]   2> 1599521 T8485 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002
   [junit4]   2> 1599521 T8485 oasc.CoreContainer.<init> New CoreContainer 1977240664
   [junit4]   2> 1599522 T8485 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/]
   [junit4]   2> 1599522 T8485 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/lib
   [junit4]   2> 1599522 T8485 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/lib).
   [junit4]   2> 1599532 T8485 oashc.HttpShardHandlerFactory.init created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1599535 T8485 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1599536 T8485 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1599537 T8485 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1599537 T8485 oasc.CoreContainer.load Node Name: 
   [junit4]   2> 1599537 T8485 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56434/foo/bar
   [junit4]   2> 1599537 T8485 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1599537 T8485 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1599538 T8485 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1599550 T8504 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dfd8181 name:ZooKeeperConnection Watcher:127.0.0.1:56434 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1599552 T8485 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1599552 T8485 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1599554 T8485 oascc.SolrZkClient.makePath makePath: /foo/bar
   [junit4]   2> 1599564 T8485 n:192.168.57.17:8983_solr oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1599568 T8507 n:192.168.57.17:8983_solr oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@312820 name:ZooKeeperConnection Watcher:127.0.0.1:56434/foo/bar got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1599568 T8485 n:192.168.57.17:8983_solr oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1599571 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1599577 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1599584 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1599590 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1599595 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1599603 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1599607 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /collections
   [junit4]   2> 1599610 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1599615 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1599619 T8485 n:192.168.57.17:8983_solr oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/192.168.57.17:8983_solr
   [junit4]   2> 1599620 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /live_nodes/192.168.57.17:8983_solr
   [junit4]   2> 1599627 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1599631 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1599635 T8485 n:192.168.57.17:8983_solr oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1599638 T8485 n:192.168.57.17:8983_solr oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 192.168.57.17:8983_solr
   [junit4]   2> 1599638 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1599646 T8485 n:192.168.57.17:8983_solr oasc.Overseer.start Overseer (id=93783287303569409-192.168.57.17:8983_solr-n_0000000000) starting
   [junit4]   2> 1599653 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1599679 T8485 n:192.168.57.17:8983_solr oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1599680 T8509 n:192.168.57.17:8983_solr oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1599680 T8485 n:192.168.57.17:8983_solr oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1599681 T8508 n:192.168.57.17:8983_solr oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1599689 T8485 n:192.168.57.17:8983_solr oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002
   [junit4]   2> 1599691 T8485 n:192.168.57.17:8983_solr oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1, loadOnStartup=true, absoluteInstDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/, schema=schema.xml, transient=false, dataDir=data/}
   [junit4]   2> 1599691 T8485 n:192.168.57.17:8983_solr oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/
   [junit4]   2> 1599691 T8485 n:192.168.57.17:8983_solr oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1599692 T8485 n:192.168.57.17:8983_solr oasc.ZkController.bootstrapConf bootstrapping config for 1 cores into ZooKeeper using solr.xml from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/
   [junit4]   2> 1599692 T8485 n:192.168.57.17:8983_solr oasc.ZkController.bootstrapConf Uploading directory /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/conf with name collection1 for SolrCore collection1
   [junit4]   2> 1599705 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/_rest_managed.json
   [junit4]   2> 1599715 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/_schema_analysis_stopwords_english.json
   [junit4]   2> 1599721 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/_schema_analysis_synonyms_english.json
   [junit4]   2> 1599727 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/admin-extra.html
   [junit4]   2> 1599736 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/admin-extra.menu-bottom.html
   [junit4]   2> 1599741 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/admin-extra.menu-top.html
   [junit4]   2> 1599748 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/clustering/carrot2/kmeans-attributes.xml
   [junit4]   2> 1599759 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/clustering/carrot2/lingo-attributes.xml
   [junit4]   2> 1599767 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/clustering/carrot2/stc-attributes.xml
   [junit4]   2> 1599781 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/currency.xml
   [junit4]   2> 1599785 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/elevate.xml
   [junit4]   2> 1599796 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/contractions_ca.txt
   [junit4]   2> 1599805 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/contractions_fr.txt
   [junit4]   2> 1599814 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/contractions_ga.txt
   [junit4]   2> 1599821 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/contractions_it.txt
   [junit4]   2> 1599829 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/hyphenations_ga.txt
   [junit4]   2> 1599836 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stemdict_nl.txt
   [junit4]   2> 1599843 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stoptags_ja.txt
   [junit4]   2> 1599850 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_ar.txt
   [junit4]   2> 1599857 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_bg.txt
   [junit4]   2> 1599865 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_ca.txt
   [junit4]   2> 1599872 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_ckb.txt
   [junit4]   2> 1599881 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_cz.txt
   [junit4]   2> 1599889 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_da.txt
   [junit4]   2> 1599896 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_de.txt
   [junit4]   2> 1599904 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_el.txt
   [junit4]   2> 1599911 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_en.txt
   [junit4]   2> 1599921 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_es.txt
   [junit4]   2> 1599927 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_eu.txt
   [junit4]   2> 1599935 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_fa.txt
   [junit4]   2> 1599941 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_fi.txt
   [junit4]   2> 1599948 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_fr.txt
   [junit4]   2> 1599955 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_ga.txt
   [junit4]   2> 1599964 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_gl.txt
   [junit4]   2> 1599971 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_hi.txt
   [junit4]   2> 1599978 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_hu.txt
   [junit4]   2> 1599986 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_hy.txt
   [junit4]   2> 1599993 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_id.txt
   [junit4]   2> 1600001 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_it.txt
   [junit4]   2> 1600007 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_ja.txt
   [junit4]   2> 1600015 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_lv.txt
   [junit4]   2> 1600023 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_nl.txt
   [junit4]   2> 1600029 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_no.txt
   [junit4]   2> 1600036 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_pt.txt
   [junit4]   2> 1600042 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_ro.txt
   [junit4]   2> 1600048 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_ru.txt
   [junit4]   2> 1600055 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_sv.txt
   [junit4]   2> 1600061 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_th.txt
   [junit4]   2> 1600068 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/stopwords_tr.txt
   [junit4]   2> 1600074 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/lang/userdict_ja.txt
   [junit4]   2> 1600080 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/mapping-FoldToASCII.txt
   [junit4]   2> 1600086 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1600092 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/protwords.txt
   [junit4]   2> 1600097 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/schema.xml
   [junit4]   2> 1600102 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/solrconfig.xml
   [junit4]   2> 1600108 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/spellings.txt
   [junit4]   2> 1600113 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/stopwords.txt
   [junit4]   2> 1600118 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/synonyms.txt
   [junit4]   2> 1600123 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/update-script.js
   [junit4]   2> 1600130 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/browse.vm
   [junit4]   2> 1600137 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/cluster.vm
   [junit4]   2> 1600143 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/cluster_results.vm
   [junit4]   2> 1600150 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/debug.vm
   [junit4]   2> 1600157 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/did_you_mean.vm
   [junit4]   2> 1600163 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/error.vm
   [junit4]   2> 1600169 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/facet_fields.vm
   [junit4]   2> 1600175 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/facet_pivot.vm
   [junit4]   2> 1600181 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/facet_queries.vm
   [junit4]   2> 1600188 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/facet_ranges.vm
   [junit4]   2> 1600194 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/facets.vm
   [junit4]   2> 1600201 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/footer.vm
   [junit4]   2> 1600206 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/head.vm
   [junit4]   2> 1600212 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/header.vm
   [junit4]   2> 1600218 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/hit.vm
   [junit4]   2> 1600224 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/hit_grouped.vm
   [junit4]   2> 1600230 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/hit_plain.vm
   [junit4]   2> 1600237 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/join_doc.vm
   [junit4]   2> 1600242 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/jquery.autocomplete.css
   [junit4]   2> 1600248 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/jquery.autocomplete.js
   [junit4]   2> 1600254 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/layout.vm
   [junit4]   2> 1600261 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/main.css
   [junit4]   2> 1600272 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/mime_type_lists.vm
   [junit4]   2> 1600279 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/pagination_bottom.vm
   [junit4]   2> 1600285 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/pagination_top.vm
   [junit4]   2> 1600290 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/product_doc.vm
   [junit4]   2> 1600297 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/query.vm
   [junit4]   2> 1600302 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/query_form.vm
   [junit4]   2> 1600308 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/query_group.vm
   [junit4]   2> 1600314 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/query_spatial.vm
   [junit4]   2> 1600320 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/README.txt
   [junit4]   2> 1600326 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/results_list.vm
   [junit4]   2> 1600333 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/richtext_doc.vm
   [junit4]   2> 1600340 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/suggest.vm
   [junit4]   2> 1600346 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/tabs.vm
   [junit4]   2> 1600352 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/velocity/VM_global_library.vm
   [junit4]   2> 1600360 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/xslt/example.xsl
   [junit4]   2> 1600367 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/xslt/example_atom.xsl
   [junit4]   2> 1600374 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/xslt/example_rss.xsl
   [junit4]   2> 1600381 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/xslt/luke.xsl
   [junit4]   2> 1600387 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /configs/collection1/xslt/updateXml.xsl
   [junit4]   2> 1600396 T8485 n:192.168.57.17:8983_solr oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002
   [junit4]   2> 1600397 T8485 n:192.168.57.17:8983_solr oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1, loadOnStartup=true, absoluteInstDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/, schema=schema.xml, transient=false, dataDir=data/}
   [junit4]   2> 1600397 T8485 n:192.168.57.17:8983_solr oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/
   [junit4]   2> 1600397 T8485 n:192.168.57.17:8983_solr oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1600399 T8511 n:192.168.57.17:8983_solr c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1600399 T8511 n:192.168.57.17:8983_solr c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1600401 T8507 n:192.168.57.17:8983_solr oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1600401 T8511 n:192.168.57.17:8983_solr oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1600403 T8508 n:192.168.57.17:8983_solr oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr",
   [junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 1600405 T8508 n:192.168.57.17:8983_solr oasco.ReplicaMutator.updateState Update state numShards=null message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr",
   [junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1600405 T8508 n:192.168.57.17:8983_solr oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1600407 T8507 n:192.168.57.17:8983_solr oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1601404 T8511 n:192.168.57.17:8983_solr oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1601404 T8511 n:192.168.57.17:8983_solr oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1601406 T8511 n:192.168.57.17:8983_solr oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:collection1
   [junit4]   2> 1601406 T8511 n:192.168.57.17:8983_solr oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1601410 T8511 n:192.168.57.17:8983_solr oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1601412 T8511 n:192.168.57.17:8983_solr oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=collection1 specified config exists in ZooKeeper
   [junit4]   2> 1601412 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/'
   [junit4]   2> 1601446 T8511 n:192.168.57.17:8983_solr oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1601458 T8511 n:192.168.57.17:8983_solr oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 1601459 T8511 n:192.168.57.17:8983_solr oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 1601462 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../contrib/extraction/lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/../../../../contrib/extraction/lib).
   [junit4]   2> 1601463 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../dist/ (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/../../../../dist).
   [junit4]   2> 1601464 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../contrib/clustering/lib/ (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/../../../../contrib/clustering/lib).
   [junit4]   2> 1601464 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../dist/ (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/../../../../dist).
   [junit4]   2> 1601464 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../contrib/langid/lib/ (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/../../../../contrib/langid/lib).
   [junit4]   2> 1601465 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../dist/ (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/../../../../dist).
   [junit4]   2> 1601465 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../contrib/velocity/lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/../../../../contrib/velocity/lib).
   [junit4]   2> 1601465 T8511 n:192.168.57.17:8983_solr oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../dist/ (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/../../../../dist).
   [junit4]   2> 1601483 T8511 n:192.168.57.17:8983_solr oasu.SolrIndexConfig.<init> IndexWriter infoStream solr logging is enabled
   [junit4]   2> 1601485 T8511 n:192.168.57.17:8983_solr oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1601531 T8511 n:192.168.57.17:8983_solr oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1601534 T8511 n:192.168.57.17:8983_solr oass.IndexSchema.readSchema Reading Solr Schema from /configs/collection1/schema.xml
   [junit4]   2> 1601548 T8511 n:192.168.57.17:8983_solr oass.IndexSchema.readSchema [collection1] Schema name=example
   [junit4]   2> 1601906 T8511 n:192.168.57.17:8983_solr oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1601907 T8511 n:192.168.57.17:8983_solr oasr.RestManager$Registry.registerManagedResource Registered ManagedResource impl org.apache.solr.rest.schema.analysis.ManagedWordSetResource for path /schema/analysis/stopwords/english
   [junit4]   2> 1601907 T8511 n:192.168.57.17:8983_solr oasr.RestManager$Registry.registerManagedResource Registered ManagedResource impl org.apache.solr.rest.schema.analysis.ManagedSynonymFilterFactory$SynonymManager for path /schema/analysis/synonyms/english
   [junit4]   2> 1601948 T8511 n:192.168.57.17:8983_solr oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1601957 T8511 n:192.168.57.17:8983_solr oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1602165 T8511 n:192.168.57.17:8983_solr oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1602165 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1602165 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/], dataDir=[null]
   [junit4]   2> 1602165 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f1c48ed
   [junit4]   2> 1602207 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrCore.initListeners [[collection1] ] Added SolrEventListener for newSearcher: [org.apache.solr.core.QuerySenderListener{queries=[]}]
   [junit4]   2> 1602207 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrCore.initListeners [[collection1] ] Added SolrEventListener for firstSearcher: [org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}]
   [junit4]   2> 1602210 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/data
   [junit4]   2> 1602211 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/data/index/
   [junit4]   2> 1602212 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1602213 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-002/collection1/data/index
   [junit4]   2> 1602214 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: init: current segments file is "segments"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@4ca2b7fd
   [junit4]   2> 1602215 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now checkpoint "" [0 segments ; isCommit = false]
   [junit4]   2> 1602215 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: 0 msec to checkpoint
   [junit4]   2> 1602216 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: init: create=true
   [junit4]   2> 1602217 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: 
   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@6e2b65f9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ab27ac5)
   [junit4]   2> 	index=
   [junit4]   2> 	version=6.0.0
   [junit4]   2> 	analyzer=org.apache.solr.update.SolrIndexConfig$DelayedSchemaAnalyzer
   [junit4]   2> 	ramBufferSizeMB=100.0
   [junit4]   2> 	maxBufferedDocs=-1
   [junit4]   2> 	maxBufferedDeleteTerms=-1
   [junit4]   2> 	mergedSegmentWarmer=null
   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
   [junit4]   2> 	commit=null
   [junit4]   2> 	openMode=CREATE
   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=-1, maxMergeCount=-1, ioThrottle=true
   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
   [junit4]   2> 	writeLockTimeout=1000
   [junit4]   2> 	codec=Lucene50
   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.DocumentsWriterPerThreadPool@64ef7bfb
   [junit4]   2> 	readerPooling=false
   [junit4]   2> 	perThreadHardLimitMB=1945
   [junit4]   2> 	useCompoundFile=false
   [junit4]   2> 	commitOnClose=true
   [junit4]   2> 	writer=org.apache.solr.update.SolrIndexWriter@51dece32
   [junit4]   2> 	
   [junit4]   2> 1602217 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now flush at close
   [junit4]   2> 1602217 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]:   start flush: applyAllDeletes=true
   [junit4]   2> 1602218 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]:   index before flush 
   [junit4]   2> 1602218 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: startFullFlush
   [junit4]   2> 1602218 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr} finishFullFlush success=true
   [junit4]   2> 1602219 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: apply all deletes during flush
   [junit4]   2> 1602219 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now apply all deletes for all segments maxDoc=0
   [junit4]   2> 1602219 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: prune sis=segments:  minGen=9223372036854775807 packetCount=0
   [junit4]   2> 1602220 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [MS][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: initDynamicDefaults spins=true maxThreadCount=1 maxMergeCount=6
   [junit4]   2> 1602220 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [MS][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: updateMergeThreads ioThrottle=true targetMBPerSec=10240.0 MB/sec
   [junit4]   2> 1602220 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [MS][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now merge
   [junit4]   2> 1602220 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [MS][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]:   index: 
   [junit4]   2> 1602221 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [MS][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]:   no more merges pending; now return
   [junit4]   2> 1602221 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: waitForMerges
   [junit4]   2> 1602221 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: waitForMerges done
   [junit4]   2> 1602222 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: commit: start
   [junit4]   2> 1602223 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: commit: enter lock
   [junit4]   2> 1602223 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: commit: now prepare
   [junit4]   2> 1602223 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: prepareCommit: flush
   [junit4]   2> 1602223 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]:   index before flush 
   [junit4]   2> 1602223 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: startFullFlush
   [junit4]   2> 1602224 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: apply all deletes during flush
   [junit4]   2> 1602224 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now apply all deletes for all segments maxDoc=0
   [junit4]   2> 1602224 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: prune sis=segments:  minGen=9223372036854775807 packetCount=0
   [junit4]   2> 1602225 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr} finishFullFlush success=true
   [junit4]   2> 1602225 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: startCommit(): start
   [junit4]   2> 1602225 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: startCommit index= changeCount=1
   [junit4]   2> 1602226 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: done all syncs: []
   [junit4]   2> 1602227 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: commit: pendingCommit != null
   [junit4]   2> 1602227 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now checkpoint "" [0 segments ; isCommit = true]
   [junit4]   2> 1602227 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6e2b65f9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ab27ac5),segFN=segments_1,generation=1}
   [junit4]   2> 1602227 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1602228 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: 0 msec to checkpoint
   [junit4]   2> 1602228 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: commit: wrote segments file "segments_1"
   [junit4]   2> 1602228 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: commit: took 5.1 msec
   [junit4]   2> 1602229 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: commit: done
   [junit4]   2> 1602229 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: rollback
   [junit4]   2> 1602229 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: all running merges have aborted
   [junit4]   2> 1602229 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: rollback: done finish merges
   [junit4]   2> 1602229 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: abort
   [junit4]   2> 1602229 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: done abort success=true
   [junit4]   2> 1602230 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: rollback: infos=
   [junit4]   2> 1602231 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now checkpoint "" [0 segments ; isCommit = false]
   [junit4]   2> 1602231 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: 0 msec to checkpoint
   [junit4]   2> 1602260 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin queryResponseWriter : 'velocity' created with startup=lazy 
   [junit4]   2> 1602296 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
   [junit4]   2> 1602428 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1602436 T8511 n:192.168.57.17:8983_solr x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1602437 T8511 n:192.168.57.17:8983_solr x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1602438 T8511 n:192.168.57.17:8983_solr x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1602439 T8511 n:192.168.57.17:8983_solr x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1602476 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin requestHandler : '/update/extract' created with startup=lazy 
   [junit4]   2> 1602476 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin requestHandler : '/analysis/field' created with startup=lazy 
   [junit4]   2> 1602476 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin requestHandler : '/analysis/document' created with startup=lazy 
   [junit4]   2> 1602476 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin requestHandler : '/spell' created with startup=lazy 
   [junit4]   2> 1602476 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin requestHandler : '/suggest' created with startup=lazy 
   [junit4]   2> 1602477 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin requestHandler : '/tvrh' created with startup=lazy 
   [junit4]   2> 1602477 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin requestHandler : '/terms' created with startup=lazy 
   [junit4]   2> 1602477 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.PluginBag.createPlugin requestHandler : '/elevate' created with startup=lazy 
   [junit4]   2> 1602477 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,/browse,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/elevate,/update/json,/admin/threads,/query,/analysis/field,/analysis/document,/spell,/update/csv,/tvrh,/select,/admin/segments,/admin/system,/suggest,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/debug/dump,/terms,/update/extract
   [junit4]   2> 1602478 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1602480 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1602480 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 1602481 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 1602481 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1602482 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: init: current segments file is "segments_1"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@4ca2b7fd
   [junit4]   2> 1602483 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: init: load commit "segments_1"
   [junit4]   2> 1602483 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6e2b65f9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ab27ac5),segFN=segments_1,generation=1}
   [junit4]   2> 1602483 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1602483 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now checkpoint "" [0 segments ; isCommit = false]
   [junit4]   2> 1602484 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: 0 msec to checkpoint
   [junit4]   2> 1602484 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: init: create=false
   [junit4]   2> 1602484 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: 
   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@6e2b65f9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ab27ac5)
   [junit4]   2> 	index=
   [junit4]   2> 	version=6.0.0
   [junit4]   2> 	analyzer=org.apache.solr.update.SolrIndexConfig$DelayedSchemaAnalyzer
   [junit4]   2> 	ramBufferSizeMB=100.0
   [junit4]   2> 	maxBufferedDocs=-1
   [junit4]   2> 	maxBufferedDeleteTerms=-1
   [junit4]   2> 	mergedSegmentWarmer=null
   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
   [junit4]   2> 	commit=null
   [junit4]   2> 	openMode=APPEND
   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=-1, maxMergeCount=-1, ioThrottle=true
   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
   [junit4]   2> 	writeLockTimeout=1000
   [junit4]   2> 	codec=Lucene50
   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.DocumentsWriterPerThreadPool@65bce1fa
   [junit4]   2> 	readerPooling=false
   [junit4]   2> 	perThreadHardLimitMB=1945
   [junit4]   2> 	useCompoundFile=false
   [junit4]   2> 	commitOnClose=true
   [junit4]   2> 	writer=org.apache.solr.update.SolrIndexWriter@78775531
   [junit4]   2> 	
   [junit4]   2> 1602484 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: flush at getReader
   [junit4]   2> 1602485 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: startFullFlush
   [junit4]   2> 1602485 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: apply all deletes during flush
   [junit4]   2> 1602485 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: now apply all deletes for all segments maxDoc=0
   [junit4]   2> 1602485 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: prune sis=segments_1:  minGen=9223372036854775807 packetCount=0
   [junit4]   2> 1602485 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: return reader version=1 reader=StandardDirectoryReader(segments_1:1:nrt)
   [junit4]   2> 1602485 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr} finishFullFlush success=true
   [junit4]   2> 1602486 T8511 n:192.168.57.17:8983_solr x:collection1 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-3861-thread-1-processing-{node_name=192.168.57.17:8983_solr}]: getReader took 2 msec
   [junit4]   2> 1602486 T8511 n:192.168.57.17:8983_solr x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@2674f52e[collection1] main
   [junit4]   2> 1602486 T8511 n:192.168.57.17:8983_solr x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1602488 T8511 n:192.168.57.17:8983_solr x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=collection1 specified config exists in ZooKeeper
   [junit4]   2> 1602489 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/collection1
   [junit4]   2> 1602490 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/collection1
   [junit4]   2> 1602490 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1602490 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/collection1
   [junit4]   2> 1602492 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 33 bytes from znode /configs/collection1/_rest_managed.json
   [junit4]   2> 1602493 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/collection1
   [junit4]   2> 1602493 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResource.processStoredData Loaded initArgs {} for /rest/managed
   [junit4]   2> 1602493 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.RestManager.init Initializing 2 registered ManagedResources
   [junit4]   2> 1602493 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage.load Reading _schema_analysis_stopwords_english.json using ZooKeeperStorageIO:path=/configs/collection1
   [junit4]   2> 1602495 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 450 bytes from znode /configs/collection1/_schema_analysis_stopwords_english.json
   [junit4]   2> 1602496 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _schema_analysis_stopwords_english.json using ZooKeeperStorageIO:path=/configs/collection1
   [junit4]   2> 1602496 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResource.processStoredData Loaded initArgs {ignoreCase=true} for /schema/analysis/stopwords/english
   [junit4]   2> 1602496 T8511 n:192.168.57.17:8983_solr x:collection1 oasrsa.ManagedWordSetResource.onManagedDataLoadedFromStorage Loaded 35 words for /schema/analysis/stopwords/english
   [junit4]   2> 1602496 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResource.notifyObserversDuringInit Notified 1 observers of /schema/analysis/stopwords/english
   [junit4]   2> 1602496 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage.load Reading _schema_analysis_synonyms_english.json using ZooKeeperStorageIO:path=/configs/collection1
   [junit4]   2> 1602499 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 172 bytes from znode /configs/collection1/_schema_analysis_synonyms_english.json
   [junit4]   2> 1602499 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _schema_analysis_synonyms_english.json using ZooKeeperStorageIO:path=/configs/collection1
   [junit4]   2> 1602499 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResource.processStoredData Loaded initArgs {ignoreCase=true,format=solr} for /schema/analysis/synonyms/english
   [junit4]   2> 1602500 T8511 n:192.168.57.17:8983_solr x:collection1 oasrsa.ManagedSynonymFilterFactory$SynonymManager.onManagedDataLoadedFromStorage Loaded 3 synonym mappings for /schema/analysis/synonyms/english
   [junit4]   2> 1602500 T8511 n:192.168.57.17:8983_solr x:collection1 oasr.ManagedResource.notifyObserversDuringInit Notified 1 observers of /schema/analysis/synonyms/english
   [junit4]   2> 1602500 T8511 n:192.168.57.17:8983_solr x:collection1 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1602501 T8511 n:192.168.57.17:8983_solr x:collection1 oass.DirectSolrSpellChecker.init init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 1602501 T8511 n:192.168.57.17:8983_solr x:collection1 oashc.SpellCheckComponent.inform No queryConverter defined, using default converter
   [junit4]   2> 1602501 T8511 n:192.168.57.17:8983_solr x:collection1 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 1602502 T8511 n:192.168.57.17:8983_solr x:collection1 oasss.SolrSuggester.init init: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string,buildOnStartup=false}
   [junit4]   2> 1602642 T8511 n:192.168.57.17:8983_solr x:collection1 oasss.SolrSuggester.init Dictionary loaded with params: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string,buildOnStartup=false}
   [junit4]   2> 1602642 T8511 n:192.168.57.17:8983_solr x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1602645 T8511 n:192.168.57.17:8983_solr x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=collection1 specified config exists in ZooKeeper
   [junit4]   2> 1603165 T8511 n:192.168.57.17:8983_solr x:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1603166 T8512 n:192.168.57.17:8983_solr x:collection1 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@2674f52e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1603166 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/collection1
   [junit4]   2> 1603168 T8511 n:192.168.57.17:8983_solr x:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1603170 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://192.168.57.17:8983/solr collection:collection1 shard:shard1
   [junit4]   2> 1603172 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1603172 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1603174 T8485 n:192.168.57.17:8983_solr oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1603178 T8518 n:192.168.57.17:8983_solr oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3cc7d07c name:ZooKeeperConnection Watcher:127.0.0.1:56434 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1603178 T8485 n:192.168.57.17:8983_solr oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1603185 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1603271 T8485 n:192.168.57.17:8983_solr oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1603274 T8485 n:192.168.57.17:8983_solr oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1977240664
   [junit4]   2> 1603275 T8485 n:192.168.57.17:8983_solr c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1603275 T8485 n:192.168.57.17:8983_solr c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1603275 T8507 n:192.168.57.17:8983_solr oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1603275 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2457 name=collection1 org.apache.solr.core.SolrCore@716b57e3 url=http://192.168.57.17:8983/solr/collection1 node=192.168.57.17:8983_solr C2457_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://192.168.57.17:8983/solr, node_name=192.168.57.17:8983_solr, state=down}
   [junit4]   2> 1603276 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasc.SyncStrategy.sync Sync replicas to http://192.168.57.17:8983/solr/collection1/
   [junit4]   2> 1603276 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1603276 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasc.SyncStrategy.syncToMe http://192.168.57.17:8983/solr/collection1/ has no replicas
   [junit4]   2> 1603276 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://192.168.57.17:8983/solr/collection1/ shard1
   [junit4]   2> 1603277 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@716b57e3
   [junit4]   2> 1603277 T8485 n:192.168.57.17:8983_solr oasc.Overseer.close Overseer (id=93783287303569409-192.168.57.17:8983_solr-n_0000000000) closing
   [junit4]   2> 1603277 T8508 n:192.168.57.17:8983_solr oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1"} current state version: 1
   [junit4]   2> 1603277 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.ZkController.unregisterConfListener removed listener for config directory [/configs/collection1]
   [junit4]   2> 1603279 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.ZkController.unregisterConfListener No more listeners for config directory [/configs/collection1]
   [junit4]   2> 1603280 T8508 n:192.168.57.17:8983_solr oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 192.168.57.17:8983_solr
   [junit4]   2> 1603280 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommit maxTime=15000ms,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 1603281 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1603283 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1603283 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1603283 T8507 n:192.168.57.17:8983_solr oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1603283 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: now flush at close
   [junit4]   2> 1603284 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]:   start flush: applyAllDeletes=true
   [junit4]   2> 1603285 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]:   index before flush 
   [junit4]   2> 1603285 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [DW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: startFullFlush
   [junit4]   2> 1603285 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [DW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1} finishFullFlush success=true
   [junit4]   2> 1603285 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: apply all deletes during flush
   [junit4]   2> 1603285 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: now apply all deletes for all segments maxDoc=0
   [junit4]   2> 1603285 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [BD][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: prune sis=segments_1:  minGen=9223372036854775807 packetCount=0
   [junit4]   2> 1603286 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [MS][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: initDynamicDefaults spins=true maxThreadCount=1 maxMergeCount=6
   [junit4]   2> 1603433 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [MS][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: updateMergeThreads ioThrottle=true targetMBPerSec=10240.0 MB/sec
   [junit4]   2> 1603433 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [MS][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: now merge
   [junit4]   2> 1603433 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [MS][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]:   index: 
   [junit4]   2> 1603433 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [MS][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]:   no more merges pending; now return
   [junit4]   2> 1603434 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: waitForMerges
   [junit4]   2> 1603434 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: waitForMerges done
   [junit4]   2> 1603434 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: commit: start
   [junit4]   2> 1603434 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: commit: enter lock
   [junit4]   2> 1603434 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: commit: now prepare
   [junit4]   2> 1603435 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: prepareCommit: flush
   [junit4]   2> 1603435 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]:   index before flush 
   [junit4]   2> 1603435 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [DW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: startFullFlush
   [junit4]   2> 1603435 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: apply all deletes during flush
   [junit4]   2> 1603436 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: now apply all deletes for all segments maxDoc=0
   [junit4]   2> 1603436 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [BD][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: prune sis=segments_1:  minGen=9223372036854775807 packetCount=0
   [junit4]   2> 1603436 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [DW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1} finishFullFlush success=true
   [junit4]   2> 1603436 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: startCommit(): start
   [junit4]   2> 1603437 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]:   skip startCommit(): no changes pending
   [junit4]   2> 1603437 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: commit: pendingCommit == null; skip
   [junit4]   2> 1603437 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: commit: wrote segments file "null"
   [junit4]   2> 1603438 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: commit: took 3.0 msec
   [junit4]   2> 1603438 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: commit: done
   [junit4]   2> 1603438 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: rollback
   [junit4]   2> 1603439 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: all running merges have aborted
   [junit4]   2> 1603439 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: rollback: done finish merges
   [junit4]   2> 1603439 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [DW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: abort
   [junit4]   2> 1603439 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [DW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: done abort success=true
   [junit4]   2> 1603439 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IW][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: rollback: infos=
   [junit4]   2> 1603440 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IFD][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: now checkpoint "" [0 segments ; isCommit = false]
   [junit4]   2> 1603440 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 C2457 oasu.LoggingInfoStream.message [IFD][coreZkRegister-3856-thread-1-processing-{node_name=192.168.57.17:8983_solr, core=collection1}]: 0 msec to checkpoint
   [junit4]   2> 1603543 T8512 n:192.168.57.17:8983_solr x:collection1 C2457 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=static+firstSearcher+warming+in+solrconfig.xml&distrib=false&event=firstSearcher} hits=0 status=0 QTime=6 
   [junit4]   2> 1603543 T8512 n:192.168.57.17:8983_solr x:collection1 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 1603543 T8512 n:192.168.57.17:8983_solr x:collection1 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
   [junit4]   2> 1603544 T8512 n:192.168.57.17:8983_solr x:collection1 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1603544 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1603556 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1603556 T8515 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.SolrException.log ERROR Error closing directory:java.lang.InterruptedException
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:180)
   [junit4]   2> 		at org.apache.solr.core.SolrCore.close(SolrCore.java:1235)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:326)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:198)
   [junit4]   2> 		at org.apache.solr.cloud.Leader

[...truncated too long message...]

x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1614675 T8564 n:192.168.57.17:8983_solr c:collection1 s:shard1 x:collection1 oasc.ElectionContext.cancelElection canceling election /collections/collection1/leader_elect/shard1/election/93783288123621378-core_node1-n_0000000000
   [junit4]   2> 1614683 T8564 n:192.168.57.17:8983_solr x:collection1 oasc.SolrException.log ERROR :org.apache.solr.common.SolrException: SolrCore not found:collection1 in []
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:217)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:198)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348)
   [junit4]   2> 		at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1050)
   [junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:863)
   [junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:817)
   [junit4]   2> 		at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:185)
   [junit4]   2> 		at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 1614699 T8485 n:192.168.57.17:8983_solr oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1614699 T8485 n:192.168.57.17:8983_solr oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-004/collection1/data [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-004/collection1/data;done=false>>]
   [junit4]   2> 1614699 T8485 n:192.168.57.17:8983_solr oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-004/collection1/data
   [junit4]   2> 1614700 T8485 n:192.168.57.17:8983_solr oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-004/collection1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-004/collection1/data/index;done=false>>]
   [junit4]   2> 1614700 T8485 n:192.168.57.17:8983_solr oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestZkChroot 1F2E2ACAFB069488-001/tempDir-004/collection1/data/index
   [junit4]   2> 1614701 T8485 n:192.168.57.17:8983_solr oasc.Overseer.close Overseer (id=93783288123621378-192.168.57.17:8983_solr-n_0000000000) closing
   [junit4]   2> 1614701 T8557 n:192.168.57.17:8983_solr oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 192.168.57.17:8983_solr
   [junit4]   2> 1616216 T8556 n:192.168.57.17:8983_solr oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1616240 T8485 n:192.168.57.17:8983_solr oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1066433604
   [junit4]   2> 1616242 T8485 n:192.168.57.17:8983_solr oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56446 56446
   [junit4]   2> 1616350 T8543 n:192.168.57.17:8983_solr oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56446 56446
   [junit4]   2> 1617693 T8485 n:192.168.57.17:8983_solr oas.SolrTestCaseJ4.tearDown ###Ending testWithUploadDir
   [junit4]   2> 1617695 T8485 n:192.168.57.17:8983_solr oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 1738980 T8485 n:192.168.57.17:8983_solr oas.SolrTestCaseJ4.endTrackingSearchers ERROR ERROR: SolrIndexSearcher opens=3 closes=2
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=ja_JP_JP_#u-ca-japanese, timezone=Etc/GMT-2
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=3,threads=1,free=147673712,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestPivotHelperCode, TestPHPSerializedResponseWriter, TestNonDefinedSimilarityFactory, HttpPartitionTest, SSLMigrationTest, CloudExitableDirectoryReaderTest, HdfsUnloadDistributedZkTest, XsltUpdateRequestHandlerTest, TestRTGBase, ZkSolrClientTest, TestDistributedMissingSort, TestShardHandlerFactory, TermsComponentTest, TestJettySolrRunner, HdfsSyncSliceTest, SignatureUpdateProcessorFactoryTest, ExitableDirectoryReaderTest, TestSolrDeletionPolicy1, SpellPossibilityIteratorTest, SpellCheckComponentTest, TestSolrConfigHandlerCloud, TestAnalyzeInfixSuggestions, HdfsCollectionsAPIDistributedZkTest, TestSearcherReuse, SolrIndexConfigTest, TestMiniSolrCloudClusterSSL, QueryResultKeyTest, SchemaVersionSpecificBehaviorTest, TestRangeQuery, TestReversedWildcardFilterFactory, HdfsNNFailoverTest, CSVRequestHandlerTest, PolyFieldTest, TestCloudPivotFacet, LeaderElectionIntegrationTest, DebugComponentTest, DistributedMLTComponentTest, SpellCheckCollatorTest, MBeansHandlerTest, CopyFieldTest, TestDFRSimilarityFactory, DisMaxRequestHandlerTest, QueryEqualityTest, TestOrdValues, TestSolrQueryParser, FieldMutatingUpdateProcessorTest, ZkStateWriterTest, TestChildDocTransformer, DistributedFacetPivotLargeTest, TestReplicationHandlerBackup, ShardRoutingCustomTest, TestLMDirichletSimilarityFactory, TestObjectReleaseTracker, TestDefaultStatsCache, TestConfig, TestSolrQueryParserDefaultOperatorResource, TestSimpleTrackingShardHandler, TestInfoStreamLogging, TestCloudSchemaless, TestMergePolicyConfig, PluginInfoTest, DateMathParserTest, TestRemoteStreaming, CursorMarkTest, TestCloudInspectUtil, TestRandomFaceting, TestLeaderElectionZkExpiry, PreAnalyzedUpdateProcessorTest, CollectionsAPIDistributedZkTest, HdfsWriteToMultipleCollectionsTest, TestSerializedLuceneMatchVersion, DateRangeFieldTest, TestSolrQueryParserResource, ShardSplitTest, DistribCursorPagingTest, TestCopyFieldCollectionResource, CollectionsAPIAsyncDistributedZkTest, AddBlockUpdateTest, DistribJoinFromCollectionTest, ZkNodePropsTest, TestLMJelinekMercerSimilarityFactory, FacetPivotSmallTest, RegexBoostProcessorTest, StandardRequestHandlerTest, QueryParsingTest, DistributedFacetPivotLongTailTest, TestDistributedGrouping, BasicZkTest, SimplePostToolTest, TestJoin, TermVectorComponentTest, TermVectorComponentDistributedTest, ConnectionManagerTest, TestExactStatsCache, TestManagedSchemaFieldTypeResource, TestValueSourceCache, ChaosMonkeySafeLeaderTest, CursorPagingTest, TestSortingResponseWriter, InfoHandlerTest, FullSolrCloudDistribCmdsTest, TestBulkSchemaAPI, HdfsChaosMonkeySafeLeaderTest, TestSolrJ, TestSearchPerf, CloudMLTQParserTest, TestDocBasedVersionConstraints, TestFastWriter, TestLuceneMatchVersion, DistributedTermsComponentTest, AsyncMigrateRouteKeyTest, StatelessScriptUpdateProcessorFactoryTest, RecoveryAfterSoftCommitTest, RuleEngineTest, TestUniqueKeyFieldResource, TestCollapseQParserPlugin, TestUtils, TestBadConfig, UnloadDistributedZkTest, RecoveryZkTest, TestZkChroot]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestZkChroot -Dtests.seed=1F2E2ACAFB069488 -Dtests.slow=true -Dtests.locale=ja_JP_JP_#u-ca-japanese -Dtests.timezone=Etc/GMT-2 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestZkChroot (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=3 closes=2
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1F2E2ACAFB069488]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:496)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:232)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4] Completed [259/487] on J1 in 142.14s, 4 tests, 1 failure, 1 error <<< FAILURES!

[...truncated 709 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:526: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:474: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:229: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:512: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1415: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:973: There were test failures: 487 suites, 1952 tests, 1 suite-level error, 1 error, 62 ignored (24 assumptions)

Total time: 69 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any