You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/09/18 10:05:12 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1836 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1836/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseG1GC

All tests passed

Build Log:
[...truncated 60132 lines...]
-documentation-lint:
    [jtidy] Checking for broken html (such as invalid tags)...
   [delete] Deleting directory /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/jtidy_tmp
     [echo] Checking for broken links...
     [exec] 
     [exec] Crawl/parse...
     [exec] 
     [exec] Verify...
     [echo] Checking for malformed docs...
     [exec] 
     [exec] /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/docs/solr-analytics/overview-summary.html
     [exec]   missing: org.apache.solr.handler.component
     [exec] 
     [exec] Missing javadocs were found!

BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:78: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:548: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:564: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:2471: exec returned: 1

Total time: 228 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 1838 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1838/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
	at __randomizedtesting.SeedInfo.seed([177DFCBD6E4B9A3:809151D3A1BBD99F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:550)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11424 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/init-core-data-001
   [junit4]   2> 3304357 T8459 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 3304358 T8459 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /gzlpr/qe
   [junit4]   2> 3304365 T8459 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 3304367 T8459 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3304369 T8460 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 3304377 T8459 oasc.ZkTestServer.run start zk server on port:51398
   [junit4]   2> 3304379 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3304384 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3304391 T8466 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@373727ab name:ZooKeeperConnection Watcher:127.0.0.1:51398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3304391 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3304392 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3304393 T8459 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 3304400 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3304402 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3304405 T8468 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f735d97 name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3304405 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3304406 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3304406 T8459 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 3304413 T8459 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 3304420 T8459 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 3304426 T8459 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 3304434 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 3304435 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 3304445 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 3304447 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 3304456 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3304457 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3304465 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 3304466 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 3304475 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 3304476 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 3304485 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 3304486 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 3304494 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 3304494 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 3304503 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3304506 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3304514 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3304514 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3304521 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 3304522 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 3304528 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 3304528 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 3304539 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3304541 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3304543 T8470 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5634ecfb name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3304544 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3304545 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 3304549 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3304550 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3304554 T8472 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43445b82 name:ZooKeeperConnection Watcher:127.0.0.1:51398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3304554 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3304555 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3304555 T8459 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 3304563 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3304565 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3304568 T8474 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d40263e name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3304568 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3304569 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3304572 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 3304574 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 3304583 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 3304584 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
   [junit4]   2> 3304592 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3304594 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3304601 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 3304603 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 3304610 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 3304611 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
   [junit4]   2> 3304620 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 3304621 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
   [junit4]   2> 3304629 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 3304630 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 3304638 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3304638 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3304647 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 3304648 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 3304658 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 3304659 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 3304669 T8459 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 3304670 T8459 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
   [junit4]   2> 3306848 T8459 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3306858 T8459 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 3306863 T8459 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51404
   [junit4]   2> 3306867 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3306867 T8459 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3306868 T8459 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-002
   [junit4]   2> 3306868 T8459 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-002/'
   [junit4]   2> 3306918 T8459 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-002/solr.xml
   [junit4]   2> 3306930 T8459 oasc.CoreContainer.<init> New CoreContainer 1463402231
   [junit4]   2> 3306930 T8459 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-002/]
   [junit4]   2> 3306931 T8459 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 3306931 T8459 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 3306932 T8459 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3306933 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3306933 T8459 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3306933 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3306934 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3306934 T8459 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3306934 T8459 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3306936 T8459 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 3306938 T8459 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3306938 T8459 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3306938 T8459 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3306939 T8459 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51398/solr
   [junit4]   2> 3306939 T8459 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3306939 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3306941 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3306944 T8485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62c5cb5f name:ZooKeeperConnection Watcher:127.0.0.1:51398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3306944 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3306945 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3306952 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3306955 T8487 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2440f293 name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3306956 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3306959 T8459 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 3306967 T8459 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 3306974 T8459 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 3306984 T8459 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 3306991 T8459 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 3307001 T8459 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 3307007 T8459 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51404_gzlpr%2Fqe
   [junit4]   2> 3307009 T8459 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51404_gzlpr%2Fqe
   [junit4]   2> 3307018 T8459 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 3307023 T8459 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 3307029 T8459 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 3307035 T8459 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51404_gzlpr%2Fqe
   [junit4]   2> 3307035 T8459 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 3307043 T8459 oasc.Overseer.start Overseer (id=92480082912542726-127.0.0.1:51404_gzlpr%2Fqe-n_0000000000) starting
   [junit4]   2> 3307052 T8459 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 3307082 T8459 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 3307084 T8489 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 3307086 T8459 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 3307093 T8459 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 3307097 T8459 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3307108 T8488 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 3307113 T8459 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 3307113 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3307117 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3307118 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3307121 T8493 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dda9c6c name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3307121 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3307121 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3307124 T8459 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3307133 T8459 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 3307133 T8459 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 3307133 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3307135 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3307137 T8495 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e2c0f98 name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3307137 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3307138 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3307143 T8496 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3307151 T8488 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
   [junit4]   2> 3307151 T8488 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 3307152 T8488 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 3307157 T8488 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
   [junit4]   2> 3307161 T8497 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3307162 T8496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3309098 T8459 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 3309098 T8459 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3309105 T8459 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 3309107 T8459 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51409
   [junit4]   2> 3309110 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3309110 T8459 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3309111 T8459 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003
   [junit4]   2> 3309111 T8459 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/'
   [junit4]   2> 3309166 T8459 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/solr.xml
   [junit4]   2> 3309188 T8459 oasc.CoreContainer.<init> New CoreContainer 137745080
   [junit4]   2> 3309189 T8459 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/]
   [junit4]   2> 3309190 T8459 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 3309190 T8459 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 3309191 T8459 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3309191 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3309192 T8459 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3309193 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3309193 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3309194 T8459 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3309194 T8459 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3309197 T8459 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 3309199 T8459 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3309200 T8459 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3309201 T8459 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3309201 T8459 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51398/solr
   [junit4]   2> 3309202 T8459 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3309202 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3309204 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3309208 T8508 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a51babe name:ZooKeeperConnection Watcher:127.0.0.1:51398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3309208 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3309209 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3309214 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3309217 T8510 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@543aa19b name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3309218 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3309238 T8459 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3310262 T8459 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51409_gzlpr%2Fqe
   [junit4]   2> 3310264 T8459 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51409_gzlpr%2Fqe
   [junit4]   2> 3310279 T8459 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 3310291 T8459 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 3310292 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3312595 T8459 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 3312596 T8459 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3312604 T8459 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 3312608 T8459 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51412
   [junit4]   2> 3312613 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3312614 T8459 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3312615 T8459 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-004
   [junit4]   2> 3312615 T8459 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-004/'
   [junit4]   2> 3312679 T8459 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-004/solr.xml
   [junit4]   2> 3312732 T8459 oasc.CoreContainer.<init> New CoreContainer 856105501
   [junit4]   2> 3312732 T8459 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-004/]
   [junit4]   2> 3312733 T8459 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 3312733 T8459 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 3312733 T8459 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3312733 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3312734 T8459 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3312734 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3312734 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3312734 T8459 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3312736 T8459 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3312744 T8459 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 3312750 T8459 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3312751 T8459 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3312752 T8459 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3312753 T8459 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51398/solr
   [junit4]   2> 3312753 T8459 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3312754 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3312756 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3312760 T8523 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bbcd596 name:ZooKeeperConnection Watcher:127.0.0.1:51398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3312760 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3312761 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3312774 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3312776 T8525 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a6887e0 name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3312777 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3312808 T8459 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3313830 T8459 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51412_gzlpr%2Fqe
   [junit4]   2> 3313832 T8459 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51412_gzlpr%2Fqe
   [junit4]   2> 3313847 T8459 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 3313862 T8459 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 3313862 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3316090 T8459 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 3316092 T8459 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3316102 T8459 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 3316108 T8459 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51415
   [junit4]   2> 3316114 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3316114 T8459 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3316115 T8459 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005
   [junit4]   2> 3316116 T8459 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/'
   [junit4]   2> 3316159 T8459 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/solr.xml
   [junit4]   2> 3316174 T8459 oasc.CoreContainer.<init> New CoreContainer 1466057745
   [junit4]   2> 3316175 T8459 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/]
   [junit4]   2> 3316175 T8459 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 3316176 T8459 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 3316176 T8459 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3316177 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3316177 T8459 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3316177 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3316178 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3316178 T8459 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3316179 T8459 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3316181 T8459 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 3316182 T8459 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3316183 T8459 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3316183 T8459 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3316183 T8459 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51398/solr
   [junit4]   2> 3316184 T8459 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3316184 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3316185 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3316188 T8538 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@282288ec name:ZooKeeperConnection Watcher:127.0.0.1:51398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3316188 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3316189 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3316200 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3316212 T8540 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19bde358 name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3316213 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3316242 T8459 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3317267 T8459 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51415_gzlpr%2Fqe
   [junit4]   2> 3317270 T8459 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51415_gzlpr%2Fqe
   [junit4]   2> 3317286 T8459 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 3317298 T8459 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 3317298 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3319345 T8459 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 3319346 T8459 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3319355 T8459 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 3319357 T8459 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51418
   [junit4]   2> 3319361 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3319362 T8459 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3319362 T8459 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006
   [junit4]   2> 3319363 T8459 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/'
   [junit4]   2> 3319414 T8459 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/solr.xml
   [junit4]   2> 3319431 T8459 oasc.CoreContainer.<init> New CoreContainer 1698033424
   [junit4]   2> 3319432 T8459 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/]
   [junit4]   2> 3319432 T8459 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 3319433 T8459 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 3319434 T8459 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3319434 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3319434 T8459 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3319434 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3319435 T8459 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3319435 T8459 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3319436 T8459 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3319438 T8459 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 3319441 T8459 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3319441 T8459 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3319442 T8459 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3319442 T8459 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51398/solr
   [junit4]   2> 3319442 T8459 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3319443 T8459 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 3319447 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3319451 T8553 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62dbe5c1 name:ZooKeeperConnection Watcher:127.0.0.1:51398 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3319451 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3319452 T8459 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 3319457 T8459 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3319459 T8555 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f2d72b4 name:ZooKeeperConnection Watcher:127.0.0.1:51398/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3319459 T8459 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3319480 T8459 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3320499 T8459 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51418_gzlpr%2Fqe
   [junit4]   2> 3320502 T8459 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51418_gzlpr%2Fqe
   [junit4]   2> 3320524 T8459 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 3320537 T8459 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 3320537 T8459 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3320647 T8501 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&action=CREATE&numShards=2&wt=javabin&version=2
   [junit4]   2> 3320652 T8496 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3320658 T8489 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField"}
   [junit4]   2> 3320660 T8558 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField"}
   [junit4]   2> 3320666 T8558 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 3320670 T8558 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 3320716 T8496 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3320749 T8488 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 3320749 T8488 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 3320750 T8488 oasc.Overseer$ClusterStateUpdater.createCollection state version solrj_collection 1
   [junit4]   2> 3320758 T8497 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3320758 T8511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3320759 T8526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3320760 T8541 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3320761 T8556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3320762 T8496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3320818 T8558 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 3320819 T8558 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:51404_gzlpr%2Fqe
   [junit4]   2> 3320823 T8558 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:51418_gzlpr%2Fqe
   [junit4]   2> 3320833 T8558 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:51409_gzlpr%2Fqe
   [junit4]   2> 3320882 T8483 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 3320886 T8558 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:51415_gzlpr%2Fqe
   [junit4]   2> 3320925 T8551 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 3321000 T8551 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 3321004 T8551 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3321006 T8532 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 3321017 T8496 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3321022 T8483 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 3321026 T8505 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 3321031 T8532 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 3321035 T8505 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 3321036 T8532 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3321037 T8505 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3321039 T8483 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3321085 T8488 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51418/gzlpr/qe",
   [junit4]   2> 	  "node_name":"127.0.0.1:51418_gzlpr%2Fqe",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 3321105 T8488 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51404/gzlpr/qe",
   [junit4]   2> 	  "node_name":"127.0.0.1:51404_gzlpr%2Fqe",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 3321114 T8496 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3321127 T8488 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51415/gzlpr/qe",
   [junit4]   2> 	  "node_name":"127.0.0.1:51415_gzlpr%2Fqe",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 3321133 T8496 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3321138 T8488 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51409/gzlpr/qe",
   [junit4]   2> 	  "node_name":"127.0.0.1:51409_gzlpr%2Fqe",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 3321146 T8496 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3321274 T8511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3321274 T8497 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3321274 T8541 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3321276 T8556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3321276 T8526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3321279 T8496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 3322012 T8551 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 3322014 T8551 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 3322015 T8551 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3322016 T8551 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 3322018 T8551 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3322018 T8551 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/solrj_collection_shard1_replica2/'
   [junit4]   2> 3322040 T8532 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 3322041 T8532 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 3322041 T8483 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 3322042 T8483 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 3322044 T8505 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 3322044 T8505 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 3322048 T8532 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3322048 T8532 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 3322052 T8505 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3322052 T8505 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 3322055 T8505 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3322056 T8505 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/solrj_collection_shard2_replica1/'
   [junit4]   2> 3322065 T8532 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3322065 T8532 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/solrj_collection_shard2_replica2/'
   [junit4]   2> 3322076 T8483 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3322076 T8483 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 3322109 T8483 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3322112 T8483 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-002/solrj_collection_shard1_replica1/'
   [junit4]   2> 3322162 T8551 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 3322194 T8551 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3322199 T8551 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3322206 T8505 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 3322207 T8551 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 3322231 T8532 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 3322241 T8505 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3322281 T8532 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3322286 T8505 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3322296 T8532 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3322307 T8483 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 3322321 T8483 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3322323 T8532 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 3322326 T8505 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 3322335 T8483 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3322344 T8483 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 3322645 T8551 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3322650 T8505 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3322679 T8505 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3322681 T8505 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3322686 T8551 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3322688 T8551 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3322724 T8532 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3322733 T8532 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3322735 T8532 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3322747 T8505 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3322752 T8551 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3322753 T8505 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3322761 T8505 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3322761 T8551 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3322765 T8505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3322766 T8505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3322767 T8505 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3322769 T8551 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3322772 T8505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3322779 T8505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3322779 T8505 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using configuration from collection solrj_collection
   [junit4]   2> 3322780 T8505 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3322781 T8505 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/solrj_collection_shard2_replica1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/solrj_collection_shard2_replica1/data/
   [junit4]   2> 3322781 T8505 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7663b62b
   [junit4]   2> 3322782 T8505 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/solrj_collection_shard2_replica1/data
   [junit4]   2> 3322782 T8505 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 3322783 T8505 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3322774 T8551 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3322785 T8551 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3322785 T8551 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3322784 T8505 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-003/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 3322788 T8505 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=31, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 3322789 T8505 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-c8b1528)),segFN=segments_1,generation=1}
   [junit4]   2> 3322790 T8505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3322793 T8505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3322795 T8505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3322795 T8505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3322801 T8505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3322796 T8551 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3322804 T8551 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3322804 T8551 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using configuration from collection solrj_collection
   [junit4]   2> 3322805 T8551 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3322806 T8551 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/solrj_collection_shard1_replica2/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/solrj_collection_shard1_replica2/data/
   [junit4]   2> 3322806 T8551 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7663b62b
   [junit4]   2> 3322803 T8505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3322809 T8551 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/solrj_collection_shard1_replica2/data
   [junit4]   2> 3322810 T8551 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 3322810 T8551 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3322811 T8551 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-006/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 3322812 T8551 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=31, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 3322813 T8551 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-78bd2325)),segFN=segments_1,generation=1}
   [junit4]   2> 3322815 T8551 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3322810 T8505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3322817 T8505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3322818 T8505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3322818 T8505 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3322819 T8505 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3322819 T8505 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3322820 T8505 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3322820 T8551 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3322822 T8551 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3322805 T8483 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3322827 T8532 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3322823 T8551 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3322829 T8551 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3322829 T8551 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3322829 T8551 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3322830 T8551 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3322831 T8551 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3322831 T8551 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3322832 T8551 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3322833 T8551 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3322833 T8551 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3322834 T8551 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3322835 T8551 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3322835 T8551 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3322835 T8551 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3322836 T8551 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3322839 T8551 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3322820 T8505 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3322844 T8505 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3322844 T8505 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3322845 T8505 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3322846 T8505 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3322847 T8505 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3322849 T8505 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3322850 T8505 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 3322827 T8483 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3322855 T8483 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3322845 T8551 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3322844 T8532 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3322865 T8551 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 3322869 T8551 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3322872 T8551 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3322875 T8505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3322878 T8505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3322880 T8532 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3322881 T8505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3322883 T8532 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3322884 T8532 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3322885 T8532 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3322886 T8551 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3322889 T8532 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3322889 T8532 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3322889 T8551 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3322890 T8532 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using configuration from collection solrj_collection
   [junit4]   2> 3322894 T8532 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3322894 T8532 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/solrj_collection_shard2_replica2/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/solrj_collection_shard2_replica2/data/
   [junit4]   2> 3322895 T8532 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7663b62b
   [junit4]   2> 3322896 T8551 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3322896 T8551 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3322896 T8532 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/solrj_collection_shard2_replica2/data
   [junit4]   2> 3322899 T8532 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 3322900 T8532 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3322901 T8532 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001/tempDir-005/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 3322901 T8532 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=31, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 3322902 T8532 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-2bd81d60)),segFN=segments_1,generation=1}
   [junit4]   2> 3322903 T8532 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3322897 T8551 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=83.6044921875, floorSegmentMB=0.560546875, forceMergeDeletesPctAllowed=17.955457698485574, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4779036779837921
   [junit4]   2> 3322908 T8551 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-78bd2325)),segFN=segments_1,generation=1}
   [junit4]   2> 3322908 T8551 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3322909 T8551 oass.SolrIndexSearcher.<init> Opening Searcher@768773da[solrj_collection_shard1_replica2] main
   [junit4]   2> 3322909 T8551 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 3322898 T8505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3322916 T8551 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3322918 T8551 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3322920 T8551 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3322921 T8551 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3322922 T8551 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3322926 T8505 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3322927 T8505 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3322928 T8505 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=83.6044921875, floorSegmentMB=0.560546875, forceMergeDeletesPctAllowed=17.955457698485574, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4779036779837921
   [junit4]   2> 3322929 T8551 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3322929 T8551 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3322931 T8551 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 3322938 T8532 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3322939 T8505 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-c8b1528)),segFN=segments_1,generation=1}
   [junit4]   2> 3322940 T8505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3322941 T8505 oass.SolrIndexSearcher.<init> Opening Searcher@408f507b[solrj_collection_shard2_replica1] main
   [junit4]   2> 3322941 T8505 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 3322939 T8551 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3322943 T8551 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3322943 T8551 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3322946 T8505 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3322946 T8505 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3322949 T8505 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3322949 T8505 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3322950 T8505 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3322951 T8483 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3322954 T8505 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3322954 T8505 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/

[...truncated too long message...]

.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:344)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:383)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:126)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:333)
   [junit4]   2> 
   [junit4]   2> 4080309 T8459 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/gzlpr/qe,null}
   [junit4]   2> 4085300 T8459 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 4085304 T8459 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51398 51398
   [junit4]   2> 4085324 T8460 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51398 51398
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=177DFCBD6E4B9A3 -Dtests.slow=true -Dtests.locale=fr_FR -Dtests.timezone=Australia/North -Dtests.file.encoding=UTF-8
   [junit4] ERROR    781s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([177DFCBD6E4B9A3:809151D3A1BBD99F]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:550)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4085683 T8459 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-177DFCBD6E4B9A3-001
   [junit4]   2> 781354 T8458 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene410: {other_tl1=PostingsFormat(name=Memory doPackFST= false), _version_=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=SimpleText), a_t=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=Memory doPackFST= false), a_i1=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=MockRandom), text=PostingsFormat(name=Lucene41VarGapFixedInterval), range_facet_l=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=Memory doPackFST= false)}, docValues:{timestamp=DocValuesFormat(name=Lucene410)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=fr_FR, timezone=Australia/North
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=2,threads=1,free=87921712,total=342777856
   [junit4]   2> NOTE: All tests run in this JVM: [TestReRankQParserPlugin, TestManagedSchemaFieldResource, TestUniqueKeyFieldResource, OverseerTest, DocValuesMultiTest, TestGroupingSearch, ChaosMonkeySafeLeaderTest, TestUpdate, TestChildDocTransformer, TestCollationFieldDocValues, TestFiltering, DirectUpdateHandlerTest, TestSearcherReuse, ReturnFieldsTest, MinimalSchemaTest, PluginInfoTest, DeleteLastCustomShardedReplicaTest, TestMultiCoreConfBootstrap, DocumentAnalysisRequestHandlerTest, TestSolrJ, CoreAdminRequestStatusTest, TestPerFieldSimilarity, QueryParsingTest, AlternateDirectoryTest, BasicFunctionalityTest, DocValuesTest, HighlighterMaxOffsetTest, UpdateParamsTest, TestDocSet, HdfsSyncSliceTest, InfoHandlerTest, FullSolrCloudDistribCmdsTest, SuggesterTSTTest, SSLMigrationTest, FileUtilsTest, ZkSolrClientTest, SpatialFilterTest, TermVectorComponentDistributedTest, HdfsBasicDistributedZk2Test, TestCopyFieldCollectionResource, CurrencyFieldOpenExchangeTest, UUIDFieldTest, NumericFieldsTest, StandardRequestHandlerTest, TestIntervalFaceting, TestCursorMarkWithoutUniqueKey, TestWriterPerf, DeleteShardTest, TestBM25SimilarityFactory, TestDistributedMissingSort, HdfsLockFactoryTest, CustomCollectionTest, TestElisionMultitermQuery, TestLeaderElectionZkExpiry, TriLevelCompositeIdRoutingTest, HighlighterConfigTest, OpenCloseCoreStressTest, TestPhraseSuggestions, TestLazyCores, TestSolr4Spatial2, TestLMDirichletSimilarityFactory, SolrIndexSplitterTest, TestSolrQueryParserResource, DeleteReplicaTest, FieldAnalysisRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestPartialUpdateDeduplication, TestFieldTypeResource, DocumentBuilderTest, TestIndexSearcher, TestPostingsSolrHighlighter, TestPHPSerializedResponseWriter, HttpPartitionTest, ShardRoutingCustomTest, TestFuzzyAnalyzedSuggestions, TestDynamicFieldResource, TestRealTimeGet, RequiredFieldsTest, BasicDistributedZkTest, TestRandomDVFaceting, PrimUtilsTest, TestBadConfig, TestCloudSchemaless, TestExceedMaxTermLength, SoftAutoCommitTest, TestCollapseQParserPlugin, SpellPossibilityIteratorTest, TestSuggestSpellingConverter, TestQueryUtils, TestCloudManagedSchemaConcurrent, RecoveryZkTest, SortByFunctionTest, OverseerRolesTest, TestPivotHelperCode, ShardRoutingTest, TestAtomicUpdateErrorCases, TestSchemaNameResource, CoreContainerCoreInitFailuresTest, TestInitQParser, XmlUpdateRequestHandlerTest, ChangedSchemaMergeTest, TestCloudManagedSchema, TestMaxScoreQueryParser, XsltUpdateRequestHandlerTest, TestSolrDeletionPolicy2, TestWordDelimiterFilterFactory, TestOmitPositions, TestSolr4Spatial, ChaosMonkeyNothingIsSafeTest, JSONWriterTest, TestManagedResource, TestOrdValues, ModifyConfFileTest, TestBinaryResponseWriter, TestJmxIntegration, TestFoldingMultitermQuery, TestFieldTypeCollectionResource, TestLuceneMatchVersion, RollingRestartTest, RAMDirectoryFactoryTest, DistributedSuggestComponentTest, ZkCLITest, TestRawResponseWriter, TestBinaryField, SolrIndexConfigTest, TestStandardQParsers, TestComponentsName, TestCSVResponseWriter, TestStressVersions, TestUtils, TestQueryTypes, SolrCmdDistributorTest, TestRemoteStreaming, TestAnalyzedSuggestions, TestSort, SliceStateTest, AddSchemaFieldsUpdateProcessorFactoryTest, QueryResultKeyTest, TestSchemaResource, DistributedDebugComponentTest, HardAutoCommitTest, TestCustomSort, HdfsDirectoryTest, SolrInfoMBeanTest, TestFastOutputStream, TestStressLucene, TestSolrXmlPersistence, TestCloudPivotFacet, TestSearchPerf, TestRestManager, CircularListTest, IndexSchemaRuntimeFieldTest, DistributedQueryElevationComponentTest, DistributedTermsComponentTest, OverseerStatusTest, DirectSolrSpellCheckerTest, RequestHandlersTest, IndexBasedSpellCheckerTest, HighlighterTest, BadIndexSchemaTest, AssignTest, TestShortCircuitedRequests, SchemaVersionSpecificBehaviorTest, TestSortingResponseWriter, DateMathParserTest, TestCodecSupport, ZkControllerTest, PeerSyncTest, SolrTestCaseJ4Test, TestNonNRTOpen, TestRandomFaceting, TestImplicitCoreProperties, TestCloudInspectUtil, DOMUtilTest, TestSweetSpotSimilarityFactory, NoCacheHeaderTest, SyncSliceTest, PreAnalyzedFieldTest, TestFieldSortValues, RemoteQueryErrorTest, DistributedQueryComponentCustomSortTest, HdfsUnloadDistributedZkTest, TestArbitraryIndexDir, TestSolrCoreProperties, TestCollectionAPI, ExternalFileFieldSortTest, QueryElevationComponentTest, TestManagedSchema, SignatureUpdateProcessorFactoryTest, UpdateRequestProcessorFactoryTest, TestMissingGroups, PingRequestHandlerTest, TestQuerySenderNoQuery, HdfsRecoveryZkTest, TestFastLRUCache, HdfsWriteToMultipleCollectionsTest, TestRandomMergePolicy, TestManagedSynonymFilterFactory, SystemInfoHandlerTest, TestValueSourceCache, TestStressReorder, TestCSVLoader, ClusterStateTest, DateRangeFieldTest, CoreAdminHandlerTest, CachingDirectoryFactoryTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 781.65s, 1 test, 1 error <<< FAILURES!

[...truncated 660 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:471: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:60: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:496: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1358: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:961: There were test failures: 429 suites, 1772 tests, 1 error, 50 ignored (22 assumptions)

Total time: 163 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 1837 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1837/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

All tests passed

Build Log:
[...truncated 70576 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:78: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:548: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:554: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1959: Tidy was unable to process file /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/docs/solr-core/org/apache/solr/core/InitParams.html, 1 returned.

Total time: 223 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any