You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/04/11 09:17:20 UTC

[JENKINS] Lucene-Solr-5.x-Windows (64bit/jdk1.7.0_76) - Build # 4543 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4543/
Java: 64bit/jdk1.7.0_76 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.TestCloudPivotFacet.test

Error Message:
init query failed: {main(facet=true&facet.pivot=%7B%21stats%3Dst2%7Dpivot_y_s1%2Cpivot_tl%2Cdense_pivot_ti1&facet.pivot=%7B%21stats%3Dst2%7Dpivot_tl%2Cpivot_i1%2Cpivot_tf&facet.limit=17&facet.offset=7&facet.pivot.mincount=131),extra(rows=0&q=id%3A%5B*+TO+461%5D&stats=true&stats.field=%7B%21key%3Dsk1+tag%3Dst1%2Cst2%7Dpivot_tl1&stats.field=%7B%21key%3Dsk2+tag%3Dst2%2Cst3%7Dpivot_f1&stats.field=%7B%21key%3Dsk3+tag%3Dst3%2Cst4%7Dpivot_y_s1&_test_min=131)}: No live SolrServers available to handle this request:[http://127.0.0.1:63329/s/x/collection1, http://127.0.0.1:63338/s/x/collection1]

Stack Trace:
java.lang.RuntimeException: init query failed: {main(facet=true&facet.pivot=%7B%21stats%3Dst2%7Dpivot_y_s1%2Cpivot_tl%2Cdense_pivot_ti1&facet.pivot=%7B%21stats%3Dst2%7Dpivot_tl%2Cpivot_i1%2Cpivot_tf&facet.limit=17&facet.offset=7&facet.pivot.mincount=131),extra(rows=0&q=id%3A%5B*+TO+461%5D&stats=true&stats.field=%7B%21key%3Dsk1+tag%3Dst1%2Cst2%7Dpivot_tl1&stats.field=%7B%21key%3Dsk2+tag%3Dst2%2Cst3%7Dpivot_f1&stats.field=%7B%21key%3Dsk3+tag%3Dst3%2Cst4%7Dpivot_y_s1&_test_min=131)}: No live SolrServers available to handle this request:[http://127.0.0.1:63329/s/x/collection1, http://127.0.0.1:63338/s/x/collection1]
	at org.apache.solr.cloud.TestCloudPivotFacet.assertPivotCountsAreCorrect(TestCloudPivotFacet.java:254)
	at org.apache.solr.cloud.TestCloudPivotFacet.test(TestCloudPivotFacet.java:228)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:63329/s/x/collection1, http://127.0.0.1:63338/s/x/collection1]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:349)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1067)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:839)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:782)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
	at org.apache.solr.cloud.TestCloudPivotFacet.assertPivotCountsAreCorrect(TestCloudPivotFacet.java:248)
	... 42 more
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:63338/s/x/collection1
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:566)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:233)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:225)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:370)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 49 more
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:152)
	at java.net.SocketInputStream.read(SocketInputStream.java:122)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:462)
	... 53 more




Build Log:
[...truncated 9912 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCloudPivotFacet
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\init-core-data-001
   [junit4]   2> 848024 T5788 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /s/x
   [junit4]   2> 848025 T5788 oasc.TestCloudPivotFacet.initUseFieldRandomizedFactor init'ing useFieldRandomizedFactor = 21
   [junit4]   2> 848029 T5788 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 848031 T5789 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 848118 T5788 oasc.ZkTestServer.run start zk server on port:63301
   [junit4]   2> 848118 T5788 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 848120 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 848124 T5796 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cdd3793 name:ZooKeeperConnection Watcher:127.0.0.1:63301 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 848125 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 848125 T5788 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 848125 T5788 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 848129 T5788 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 848130 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 848133 T5799 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e19f6ce name:ZooKeeperConnection Watcher:127.0.0.1:63301/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 848134 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 848134 T5788 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 848134 T5788 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 848136 T5788 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 848139 T5788 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 848140 T5788 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 848143 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 848143 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 848148 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 848150 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 848152 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 848152 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 848155 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 848156 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 848157 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 848157 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 848160 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 848161 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 848163 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 848164 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 848168 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 848168 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 848171 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 848171 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 848173 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 848174 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 848176 T5788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 848176 T5788 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 848480 T5788 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1
   [junit4]   2> 848483 T5788 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 848487 T5788 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63308
   [junit4]   2> 848487 T5788 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/s/x, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores, solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\tempDir-001/control/data, hostPort=63308}
   [junit4]   2> 848488 T5788 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@2bb0bf9a
   [junit4]   2> 848488 T5788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\'
   [junit4]   2> 848511 T5788 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\solr.xml
   [junit4]   2> 848536 T5788 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores
   [junit4]   2> 848536 T5788 oasc.CoreContainer.<init> New CoreContainer 1605474728
   [junit4]   2> 848536 T5788 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\]
   [junit4]   2> 848536 T5788 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\lib
   [junit4]   2> 848537 T5788 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\lib).
   [junit4]   2> 848544 T5788 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 848544 T5788 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 848544 T5788 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 848544 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 848545 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 848545 T5788 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 848545 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 848545 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 848545 T5788 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 848546 T5788 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 848546 T5788 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 848549 T5788 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 848549 T5788 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 848549 T5788 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 848549 T5788 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 848550 T5788 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63301/solr
   [junit4]   2> 848550 T5788 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 848550 T5788 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 848551 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 848553 T5811 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3187ec3 name:ZooKeeperConnection Watcher:127.0.0.1:63301 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 848554 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 848554 T5788 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 848556 T5790 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14ca737b5010002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 848558 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 848560 T5814 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b097c93 name:ZooKeeperConnection Watcher:127.0.0.1:63301/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 848560 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 848562 T5788 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 848565 T5788 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 848567 T5788 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 848573 T5788 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 848576 T5788 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 848578 T5788 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 848581 T5788 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 848582 T5788 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 848584 T5788 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63308_s%2Fx
   [junit4]   2> 848584 T5788 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63308_s%2Fx
   [junit4]   2> 848588 T5788 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 848589 T5788 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 848591 T5788 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 848593 T5788 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:63308_s%2Fx
   [junit4]   2> 848593 T5788 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 848594 T5788 oasc.Overseer.start Overseer (id=93633549969719299-127.0.0.1:63308_s%2Fx-n_0000000000) starting
   [junit4]   2> 848597 T5788 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 848605 T5788 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 848605 T5816 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 848605 T5788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 848606 T5815 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 848611 T5788 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores
   [junit4]   2> 848614 T5788 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {shard=, config=solrconfig.xml, dataDir=data\, coreNodeName=, collection=control_collection, name=collection1, schema=schema.xml, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1, loadOnStartup=true, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\, transient=false}
   [junit4]   2> 848615 T5788 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\
   [junit4]   2> 848616 T5788 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 848616 T5818 C:control_collection c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 848616 T5818 C:control_collection c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 848617 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 848617 T5818 C:control_collection c:collection1 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 848618 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63308/s/x",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "node_name":"127.0.0.1:63308_s%2Fx",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 0
   [junit4]   2> 848619 T5815 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63308/s/x",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "node_name":"127.0.0.1:63308_s%2Fx",
   [junit4]   2> 	  "collection":"control_collection"}
   [junit4]   2> 848619 T5815 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 848619 T5815 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 848621 T5814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 849486 T5818 C:control_collection c:collection1 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 849486 T5818 C:control_collection c:collection1 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 849486 T5818 C:control_collection c:collection1 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 849487 T5818 C:control_collection c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 849487 T5818 C:control_collection c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 849488 T5818 C:control_collection c:collection1 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\'
   [junit4]   2> 849499 T5818 C:control_collection c:collection1 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 849504 T5818 C:control_collection c:collection1 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 849511 T5818 C:control_collection c:collection1 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 849530 T5818 C:control_collection c:collection1 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
   [junit4]   2> 849570 T5818 C:control_collection c:collection1 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 849571 T5818 C:control_collection c:collection1 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 849580 T5818 C:control_collection c:collection1 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 849841 T5818 C:control_collection c:collection1 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 849851 T5818 C:control_collection c:collection1 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 849852 T5818 C:control_collection c:collection1 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 849859 T5818 C:control_collection c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 849863 T5818 C:control_collection c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 849865 T5818 C:control_collection c:collection1 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 849866 T5818 C:control_collection c:collection1 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 849866 T5818 C:control_collection c:collection1 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 849866 T5818 C:control_collection c:collection1 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 849867 T5818 C:control_collection c:collection1 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 849867 T5818 C:control_collection c:collection1 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 849867 T5818 C:control_collection c:collection1 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 849868 T5818 C:control_collection c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 849869 T5818 C:control_collection c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\data\
   [junit4]   2> 849869 T5818 C:control_collection c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d683899
   [junit4]   2> 849869 T5818 C:control_collection c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\data\
   [junit4]   2> 849869 T5818 C:control_collection c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\data\index/
   [junit4]   2> 849869 T5818 C:control_collection c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 849869 T5818 C:control_collection c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\control-001\cores\collection1\data\index
   [junit4]   2> 849869 T5818 C:control_collection c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=35.904296875, floorSegmentMB=0.2783203125, forceMergeDeletesPctAllowed=10.720414626436925, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7035764228355397
   [junit4]   2> 849870 T5818 C:control_collection c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3f3dc345 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6fdf0772),segFN=segments_1,generation=1}
   [junit4]   2> 849870 T5818 C:control_collection c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 849874 T5818 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 849874 T5818 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 849875 T5818 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 849875 T5818 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 849875 T5818 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 849875 T5818 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 849875 T5818 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 849875 T5818 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 849875 T5818 C:control_collection c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 849881 T5818 C:control_collection c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849882 T5818 C:control_collection c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849884 T5818 C:control_collection c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849885 T5818 C:control_collection c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849889 T5818 C:control_collection c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/logging,/admin/ping,/admin/segments,/admin/mbeans,/schema,/admin/properties,/get,/update/json,/admin/system,/admin/threads,/replication,/admin/file,/update/csv,/update/json/docs,/update,/config,standard,/admin/plugins,/admin/luke
   [junit4]   2> 849890 T5818 C:control_collection c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 849891 T5818 C:control_collection c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 849891 T5818 C:control_collection c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 849893 T5818 C:control_collection c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 849893 T5818 C:control_collection c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 849893 T5818 C:control_collection c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=82.7412109375, floorSegmentMB=1.466796875, forceMergeDeletesPctAllowed=9.491470019215242, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 849894 T5818 C:control_collection c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3f3dc345 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6fdf0772),segFN=segments_1,generation=1}
   [junit4]   2> 849894 T5818 C:control_collection c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 849894 T5818 C:control_collection c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@5972e897[collection1] main
   [junit4]   2> 849894 T5818 C:control_collection c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 849895 T5818 C:control_collection c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 849895 T5818 C:control_collection c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 849896 T5818 C:control_collection c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 849896 T5818 C:control_collection c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 849896 T5818 C:control_collection c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 849897 T5818 C:control_collection c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 849897 T5818 C:control_collection c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 849897 T5818 C:control_collection c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 849897 T5818 C:control_collection c:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 849897 T5818 C:control_collection c:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 849897 T5819 C:control_collection c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5972e897[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 849897 T5822 C:control_collection S:shard1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63308/s/x collection:control_collection shard:shard1
   [junit4]   2> 849898 T5788 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1
   [junit4]   2> 849898 T5788 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 849900 T5822 C:control_collection S:shard1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 849900 T5788 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 849901 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 849903 T5825 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fc6110a name:ZooKeeperConnection Watcher:127.0.0.1:63301/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 849903 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 849903 T5788 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 849903 T5788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 849906 T5822 C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 849908 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 849908 T5822 C:control_collection S:shard1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 849908 T5822 C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1976 name=collection1 org.apache.solr.core.SolrCore@56243acd url=http://127.0.0.1:63308/s/x/collection1 node=127.0.0.1:63308_s%2Fx C1976_STATE=coll:control_collection core:collection1 props:{base_url=http://127.0.0.1:63308/s/x, state=down, core=collection1, node_name=127.0.0.1:63308_s%2Fx}
   [junit4]   2> 849908 T5822 C:control_collection S:shard1 C1976 P63308 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63308/s/x/collection1/
   [junit4]   2> 849908 T5822 C:control_collection S:shard1 C1976 P63308 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 849909 T5822 C:control_collection S:shard1 C1976 P63308 oasc.SyncStrategy.syncToMe http://127.0.0.1:63308/s/x/collection1/ has no replicas
   [junit4]   2> 849909 T5822 C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63308/s/x/collection1/ shard1
   [junit4]   2> 849909 T5822 C:control_collection S:shard1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 849909 T5788 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 849909 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 849914 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 849915 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63308/s/x",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 1
   [junit4]   2> 850005 T5814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 850007 T5825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 850048 T5822 C:control_collection S:shard1 oasc.ZkController.register We are http://127.0.0.1:63308/s/x/collection1/ and leader is http://127.0.0.1:63308/s/x/collection1/
   [junit4]   2> 850048 T5822 C:control_collection S:shard1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63308/s/x
   [junit4]   2> 850048 T5822 C:control_collection S:shard1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 850048 T5822 C:control_collection S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 850048 T5822 C:control_collection S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 850049 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 850051 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63308/s/x",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "node_name":"127.0.0.1:63308_s%2Fx",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 2
   [junit4]   2> 850051 T5815 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63308/s/x",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "node_name":"127.0.0.1:63308_s%2Fx",
   [junit4]   2> 	  "collection":"control_collection"}
   [junit4]   2> 850141 T5814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 850142 T5825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 850160 T5788 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1
   [junit4]   2> 850162 T5788 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001
   [junit4]   2> 850163 T5788 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 850166 T5788 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63320
   [junit4]   2> 850166 T5788 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solrconfig=solrconfig.xml, hostPort=63320, hostContext=/s/x, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores, solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\tempDir-001/jetty1}
   [junit4]   2> 850166 T5788 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@2bb0bf9a
   [junit4]   2> 850166 T5788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\'
   [junit4]   2> 850191 T5788 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\solr.xml
   [junit4]   2> 850214 T5788 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores
   [junit4]   2> 850215 T5788 oasc.CoreContainer.<init> New CoreContainer 639950401
   [junit4]   2> 850215 T5788 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\]
   [junit4]   2> 850215 T5788 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\lib
   [junit4]   2> 850215 T5788 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\lib).
   [junit4]   2> 850223 T5788 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 850223 T5788 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 850223 T5788 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 850223 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 850224 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 850224 T5788 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 850224 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 850224 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 850224 T5788 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 850224 T5788 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 850225 T5788 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 850228 T5788 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 850228 T5788 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 850228 T5788 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 850229 T5788 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 850229 T5788 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63301/solr
   [junit4]   2> 850229 T5788 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 850229 T5788 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 850231 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 850233 T5837 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3baeb4e9 name:ZooKeeperConnection Watcher:127.0.0.1:63301 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 850233 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 850233 T5788 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 850239 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 850239 T5840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d5b4048 name:ZooKeeperConnection Watcher:127.0.0.1:63301/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 850240 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 850245 T5788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 851119 T5788 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63320_s%2Fx
   [junit4]   2> 851120 T5788 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63320_s%2Fx
   [junit4]   2> 851123 T5788 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 851126 T5788 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores
   [junit4]   2> 851128 T5788 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {collection=collection1, coreNodeName=, transient=false, name=collection1, dataDir=data\, loadOnStartup=true, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\, config=solrconfig.xml, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1, shard=, schema=schema.xml}
   [junit4]   2> 851128 T5788 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\
   [junit4]   2> 851128 T5788 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 851129 T5841 C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 851129 T5841 C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 851130 T5841 C:collection1 c:collection1 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 851130 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 851131 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63320/s/x",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "node_name":"127.0.0.1:63320_s%2Fx",
   [junit4]   2> 	  "collection":"collection1"} current state version: 3
   [junit4]   2> 851132 T5815 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63320/s/x",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "node_name":"127.0.0.1:63320_s%2Fx",
   [junit4]   2> 	  "collection":"collection1"}
   [junit4]   2> 851132 T5815 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 851132 T5815 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 851221 T5840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 851222 T5814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 851222 T5825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 851999 T5841 C:collection1 c:collection1 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 851999 T5841 C:collection1 c:collection1 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 852000 T5841 C:collection1 c:collection1 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 852000 T5841 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 852001 T5841 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 852001 T5841 C:collection1 c:collection1 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\'
   [junit4]   2> 852012 T5841 C:collection1 c:collection1 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 852015 T5841 C:collection1 c:collection1 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 852022 T5841 C:collection1 c:collection1 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 852034 T5841 C:collection1 c:collection1 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
   [junit4]   2> 852071 T5841 C:collection1 c:collection1 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 852073 T5841 C:collection1 c:collection1 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 852079 T5841 C:collection1 c:collection1 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 852291 T5841 C:collection1 c:collection1 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 852298 T5841 C:collection1 c:collection1 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 852300 T5841 C:collection1 c:collection1 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 852309 T5841 C:collection1 c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 852312 T5841 C:collection1 c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 852315 T5841 C:collection1 c:collection1 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 852315 T5841 C:collection1 c:collection1 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 852315 T5841 C:collection1 c:collection1 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 852315 T5841 C:collection1 c:collection1 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 852316 T5841 C:collection1 c:collection1 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 852316 T5841 C:collection1 c:collection1 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 852316 T5841 C:collection1 c:collection1 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 852317 T5841 C:collection1 c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 852317 T5841 C:collection1 c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\data\
   [junit4]   2> 852317 T5841 C:collection1 c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d683899
   [junit4]   2> 852318 T5841 C:collection1 c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\data\
   [junit4]   2> 852318 T5841 C:collection1 c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\data\index/
   [junit4]   2> 852318 T5841 C:collection1 c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 852318 T5841 C:collection1 c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-1-001\cores\collection1\data\index
   [junit4]   2> 852318 T5841 C:collection1 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=35.904296875, floorSegmentMB=0.2783203125, forceMergeDeletesPctAllowed=10.720414626436925, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7035764228355397
   [junit4]   2> 852319 T5841 C:collection1 c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5417a2e7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bc816d2),segFN=segments_1,generation=1}
   [junit4]   2> 852319 T5841 C:collection1 c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 852323 T5841 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 852324 T5841 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 852324 T5841 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 852324 T5841 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 852324 T5841 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 852324 T5841 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 852325 T5841 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 852325 T5841 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 852325 T5841 C:collection1 c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 852330 T5841 C:collection1 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 852331 T5841 C:collection1 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 852332 T5841 C:collection1 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 852333 T5841 C:collection1 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 852340 T5841 C:collection1 c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/logging,/admin/ping,/admin/segments,/admin/mbeans,/schema,/admin/properties,/get,/update/json,/admin/system,/admin/threads,/replication,/admin/file,/update/csv,/update/json/docs,/update,/config,standard,/admin/plugins,/admin/luke
   [junit4]   2> 852341 T5841 C:collection1 c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 852342 T5841 C:collection1 c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 852343 T5841 C:collection1 c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 852343 T5841 C:collection1 c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 852343 T5841 C:collection1 c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 852344 T5841 C:collection1 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=82.7412109375, floorSegmentMB=1.466796875, forceMergeDeletesPctAllowed=9.491470019215242, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 852344 T5841 C:collection1 c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5417a2e7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bc816d2),segFN=segments_1,generation=1}
   [junit4]   2> 852344 T5841 C:collection1 c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 852345 T5841 C:collection1 c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@6a073632[collection1] main
   [junit4]   2> 852345 T5841 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 852346 T5841 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 852346 T5841 C:collection1 c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 852347 T5841 C:collection1 c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 852347 T5841 C:collection1 c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 852347 T5841 C:collection1 c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 852348 T5841 C:collection1 c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 852348 T5841 C:collection1 c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 852349 T5841 C:collection1 c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 852349 T5841 C:collection1 c:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 852349 T5842 C:collection1 c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a073632[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 852349 T5841 C:collection1 c:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 852350 T5845 C:collection1 S:shard1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63320/s/x collection:collection1 shard:shard1
   [junit4]   2> 852350 T5788 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1
   [junit4]   2> 852350 T5788 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 852351 T5845 C:collection1 S:shard1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 852355 T5845 C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 852357 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 852357 T5845 C:collection1 S:shard1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 852357 T5845 C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1977 name=collection1 org.apache.solr.core.SolrCore@bcf9dc5 url=http://127.0.0.1:63320/s/x/collection1 node=127.0.0.1:63320_s%2Fx C1977_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:63320/s/x, state=down, core=collection1, node_name=127.0.0.1:63320_s%2Fx}
   [junit4]   2> 852357 T5845 C:collection1 S:shard1 C1977 P63320 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63320/s/x/collection1/
   [junit4]   2> 852358 T5845 C:collection1 S:shard1 C1977 P63320 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 852358 T5845 C:collection1 S:shard1 C1977 P63320 oasc.SyncStrategy.syncToMe http://127.0.0.1:63320/s/x/collection1/ has no replicas
   [junit4]   2> 852358 T5845 C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63320/s/x/collection1/ shard1
   [junit4]   2> 852359 T5845 C:collection1 S:shard1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 852359 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 852363 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 852363 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63320/s/x",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 4
   [junit4]   2> 852453 T5840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 852453 T5814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 852453 T5825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 852495 T5845 C:collection1 S:shard1 oasc.ZkController.register We are http://127.0.0.1:63320/s/x/collection1/ and leader is http://127.0.0.1:63320/s/x/collection1/
   [junit4]   2> 852495 T5845 C:collection1 S:shard1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63320/s/x
   [junit4]   2> 852495 T5845 C:collection1 S:shard1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 852495 T5845 C:collection1 S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 852495 T5845 C:collection1 S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 852500 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 852521 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63320/s/x",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "node_name":"127.0.0.1:63320_s%2Fx",
   [junit4]   2> 	  "collection":"collection1"} current state version: 5
   [junit4]   2> 852522 T5815 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63320/s/x",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "node_name":"127.0.0.1:63320_s%2Fx",
   [junit4]   2> 	  "collection":"collection1"}
   [junit4]   2> 852523 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 852525 T5814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 852525 T5825 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 852528 T5840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 852643 T5788 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\cores\collection1
   [junit4]   2> 852645 T5788 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001
   [junit4]   2> 852645 T5788 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 852648 T5788 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63329
   [junit4]   2> 852648 T5788 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solrconfig=solrconfig.xml, hostPort=63329, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\cores, hostContext=/s/x, solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\tempDir-001/jetty2}
   [junit4]   2> 852648 T5788 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@2bb0bf9a
   [junit4]   2> 852648 T5788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\'
   [junit4]   2> 852673 T5788 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\solr.xml
   [junit4]   2> 852707 T5788 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\cores
   [junit4]   2> 852708 T5788 oasc.CoreContainer.<init> New CoreContainer 736888322
   [junit4]   2> 852708 T5788 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\]
   [junit4]   2> 852708 T5788 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\lib
   [junit4]   2> 852708 T5788 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\lib).
   [junit4]   2> 852716 T5788 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 852716 T5788 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 852716 T5788 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 852716 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 852716 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 852716 T5788 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 852717 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 852717 T5788 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 852717 T5788 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 852717 T5788 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 852717 T5788 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 852720 T5788 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 852720 T5788 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 852720 T5788 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 852720 T5788 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 852721 T5788 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63301/solr
   [junit4]   2> 852721 T5788 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 852721 T5788 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 852723 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 852724 T5857 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5870d2ac name:ZooKeeperConnection Watcher:127.0.0.1:63301 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 852724 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 852725 T5788 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 852727 T5790 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14ca737b5010007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 852728 T5788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 852729 T5860 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4088289c name:ZooKeeperConnection Watcher:127.0.0.1:63301/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 852730 T5788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 852736 T5788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 853612 T5788 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63329_s%2Fx
   [junit4]   2> 853613 T5788 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63329_s%2Fx
   [junit4]   2> 853616 T5788 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 853619 T5788 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\cores
   [junit4]   2> 853619 T5788 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {schema=schema.xml, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\cores\collection1\, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\cores\collection1, config=solrconfig.xml, collection=collection1, loadOnStartup=true, shard=, dataDir=data\, name=collection1, coreNodeName=, transient=false}
   [junit4]   2> 853619 T5788 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001\shard-2-001\cores\collection1\
   [junit4]   2> 853619 T5788 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 853621 T5861 C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 853621 T5861 C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 853622 T5814 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 853622 T5861 C:collection1 c:collection1 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 853623 T5815 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63329/s/x",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2

[...truncated too long message...]

Exception: Read timed out
   [junit4]    > 	at java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:152)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:122)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
   [junit4]    > 	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    > 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
   [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:462)
   [junit4]    > 	... 53 moreThrowable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5847, name=qtp1218532333-5847, state=RUNNABLE, group=TGRP-TestCloudPivotFacet]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4C2D951C16D771D9]:0)
   [junit4]    > 	at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:708)
   [junit4]    > 	at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1152449 T5788 C:control_collection S:shard1 c:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestCloudPivotFacet 4C2D951C16D771D9-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {multiDefault=PostingsFormat(name=Memory doPackFST= true), dense_pivot_ti=PostingsFormat(name=Memory doPackFST= false), pivot_d1=PostingsFormat(name=Memory doPackFST= false), pivot_td=Lucene50(blocksize=128), timestamp=PostingsFormat(name=Memory doPackFST= false), pivot_tl=Lucene50(blocksize=128), pivot_tf=PostingsFormat(name=LuceneVarGapDocFreqInterval), pivot_td1=PostingsFormat(name=Memory doPackFST= true), dense_pivot_i=PostingsFormat(name=Memory doPackFST= true), dense_pivot_i1=Lucene50(blocksize=128), dense_pivot_y_s=PostingsFormat(name=Memory doPackFST= true), id=Lucene50(blocksize=128), pivot_z_s1=PostingsFormat(name=Memory doPackFST= true), pivot_y_s1=PostingsFormat(name=LuceneVarGapDocFreqInterval), pivot_i=PostingsFormat(name=Memory doPackFST= true), dense_pivot_ti1=Lucene50(blocksize=128), intDefault=PostingsFormat(name=Memory doPackFST= false), pivot_ti=PostingsFormat(name=Memory doPackFST= false), _version_=PostingsFormat(name=Memory doPackFST= false), pivot_x_s1=PostingsFormat(name=Memory doPackFST= false), pivot_ti1=PostingsFormat(name=LuceneVarGapDocFreqInterval), pivot_l=PostingsFormat(name=LuceneVarGapDocFreqInterval), pivot_b1=PostingsFormat(name=Memory doPackFST= true), range_facet_l=PostingsFormat(name=Memory doPackFST= false), pivot_f=Lucene50(blocksize=128), pivot_b=Lucene50(blocksize=128), pivot_dt=Lucene50(blocksize=128), pivot_y_s=PostingsFormat(name=Memory doPackFST= true), pivot_tdt=PostingsFormat(name=LuceneVarGapDocFreqInterval), dense_pivot_y_s1=PostingsFormat(name=LuceneVarGapDocFreqInterval), dense_pivot_x_s=Lucene50(blocksize=128), pivot_f1=PostingsFormat(name=Memory doPackFST= true), dense_pivot_x_s1=PostingsFormat(name=Memory doPackFST= false), pivot_i1=Lucene50(blocksize=128), pivot_tdt1=PostingsFormat(name=Memory doPackFST= false), pivot_z_s=Lucene50(blocksize=128), pivot_dt1=PostingsFormat(name=Memory doPackFST= true), pivot_l1=PostingsFormat(name=Memory doPackFST= false), pivot_d=PostingsFormat(name=LuceneVarGapDocFreqInterval), pivot_x_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), pivot_tl1=PostingsFormat(name=Memory doPackFST= true), pivot_tf1=PostingsFormat(name=Memory doPackFST= false)}, docValues:{timestamp=DocValuesFormat(name=Lucene50)}, sim=DefaultSimilarity, locale=fr_FR, timezone=America/Argentina/Jujuy
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_76 (64-bit)/cpus=3,threads=1,free=374306744,total=429391872
   [junit4]   2> NOTE: All tests run in this JVM: [TestSimpleTrackingShardHandler, MinimalSchemaTest, DistributedSuggestComponentTest, TestRawResponseWriter, DebugComponentTest, DirectUpdateHandlerOptimizeTest, TestObjectReleaseTracker, TestCodecSupport, JsonLoaderTest, StandardRequestHandlerTest, TestFuzzyAnalyzedSuggestions, TestSchemaNameResource, SchemaVersionSpecificBehaviorTest, TestLMDirichletSimilarityFactory, TestBulkSchemaAPI, IndexSchemaTest, AtomicUpdatesTest, TestReload, UpdateParamsTest, TestRecovery, DirectSolrSpellCheckerTest, TermsComponentTest, TestFiltering, TestCloudManagedSchemaConcurrent, TestRemoteStreaming, RequestLoggingTest, TestDistributedGrouping, TestStressUserVersions, DeleteLastCustomShardedReplicaTest, SolrIndexConfigTest, TestValueSourceCache, MBeansHandlerTest, TestFastOutputStream, HdfsThreadLeakTest, ActionThrottleTest, BadIndexSchemaTest, SpellPossibilityIteratorTest, RecoveryAfterSoftCommitTest, TestFieldTypeCollectionResource, TestSerializedLuceneMatchVersion, TestCoreDiscovery, TestDocSet, QueryEqualityTest, VMParamsZkACLAndCredentialsProvidersTest, TestRestManager, DeleteReplicaTest, RankQueryTest, SuggesterTSTTest, TestPivotHelperCode, OverriddenZkACLAndCredentialsProvidersTest, SpatialHeatmapFacetsTest, TermVectorComponentTest, TestCryptoKeys, DistributedFacetPivotLargeTest, PreAnalyzedUpdateProcessorTest, TestUtils, TestSolrDeletionPolicy1, SharedFSAutoReplicaFailoverTest, XsltUpdateRequestHandlerTest, DistributedTermsComponentTest, TestOverriddenPrefixQueryForCustomFieldType, TestSolrConfigHandlerConcurrent, TestLuceneMatchVersion, TestCloudManagedSchema, QueryParsingTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestCollectionAPI, TestSolr4Spatial, TestNonDefinedSimilarityFactory, AssignTest, TestRecoveryHdfs, TestExpandComponent, TestDefaultSimilarityFactory, TestSolrXml, TestMergePolicyConfig, TestCloudPivotFacet]
   [junit4] Completed [180/482] on J1 in 304.46s, 1 test, 1 error <<< FAILURES!

[...truncated 941 lines...]
   [junit4] JVM J1: stdout was not empty, see: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\temp\junit4-J1-20150411_062857_730.sysout
   [junit4] >>> JVM J1: stdout (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\heapdumps\java_pid4852.hprof ...
   [junit4] Heap dump file created [540065218 bytes in 9.359 secs]
   [junit4] <<< JVM J1: EOF ----

[...truncated 12 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:536: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:484: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build.xml:229: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\common-build.xml:510: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:1434: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:991: There were test failures: 482 suites, 1914 tests, 1 error, 58 ignored (30 assumptions)

Total time: 64 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0_76 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any